Backlash compensation with filtered prediction in discrete time nonlinear systems by dynamic inversion using neural networks

ABSTRACT

Methods and apparatuses for backlash compensation. A dynamics inversion compensation scheme is designed for control of nonlinear discrete-time systems with input backlash. The techniques of this disclosure extend the dynamic inversion technique to discrete-time systems by using a filtered prediction, and shows how to use a neural network (NN) for inverting the backlash nonlinearity in the feedforward path. The techniques provide a general procedure for using NN to determine the dynamics preinverse of an invertible discrete time dynamical system. A discrete-time tuning algorithm is given for the NN weights so that the backlash compensation scheme guarantees bounded tracking and backlash errors, and also bounded parameter estimates. A rigorous proof of stability and performance is given and a simulation example verifies performance. Unlike standard discrete-time adaptive control techniques, no certainty equivalence (CE) or linear-in-the-parameters (LIP) assumptions are needed.

This application claims priority to provisional patent application Ser. No. 60/237,580 filed Oct. 3, 2000, entitled, “Backlash Compensation with Filtered Prediction in Discrete Time Nonlinear Systems by Dynamic Inversion Using Neural Networks” by Javier Campos and Frank L. Lewis. That entire disclosure is specifically incorporated by reference herein without disclaimer.

The government may own rights to portions of the present invention pursuant to Army Research Office Grant 39657-MA, ARO Grant DAAD19-99-1-0137, and Texas ATP Grant 003656-027.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates generally to the fields of neural networks. More particularly, it concerns using neural networks for backlash compensation in mechanical systems.

2. Description of Related Art

Many physical components of control systems have nonsmooth nonlinear characteristics such as deadzone and backlash. These are particularly common in actuators, such as mechanical connections, hydraulic servovalves and electric servomotors. The difference between toothspace and tooth width in mechanical system is known as backlash, and it is necessary to allow two gears mesh without jamming. Any amount of backlash greater than the minimum amount necessary to ensure satisfactory meshing of gears can result in instability in dynamics situations and position errors in gear trains. Backlash often severely limits the performance of feedback systems by causing delays, oscillations, and inaccuracy. In fact, there are many applications such as instrument differential gear trains and servomechanisms that require the complete elimination of backlash in order to function properly.

Many mechanical solutions have been developed to overcome backlash, for example spring-loaded split gear assemblies and dual motor systems. These mechanical solutions can satisfactorily handle some backlash problems, but they give rise to other problems like decreased accuracy and reduced bandwidth. They are also expensive, energy consuming and increase the overall weight of the system. A backlash compensation scheme not based on mechanical devices would be more convenient.

In most applications, backlash parameters are either poorly known or completely unknown, which represents a challenge for the control design engineer. Proportional-derivative (PD) controllers have been observed to result in limit cycles if the actuators have nonlinearities such as backlash or deadzones. To overcome the PD controller limitations, several techniques have been applied to compensate for the actuator nonlinearities. These techniques include adaptive control, fuzzy logic and neural networks.

Many systems with actuator nonlinearities such as deadzone and backlash are modeled in discrete time. Moreover, for implementation as a digital controller, a discrete-time actuator nonlinearity compensator is needed. To address discrete-time deadzone compensation, at least one group has proposed a specific adaptive control approach. Also a specific fuzzy logic (FL) deadzone compensation discrete time scheme has been proposed. Adaptive control approaches for backlash compensation in discrete time have also been proposed. These conventional methods, however, all require a linear in the parameter assumption.

Neural Networks (NN) have been used extensively in feedback control systems. Specifically, it has been observed that the use of PD controllers may result in limit cycles if actuators have deadzones or backlash. Rigorous results for motion tracking of such systems are notably sparse, though ad hoc techniques relying on simulations for verification of effectiveness are prolific.

Although some NN applications show at least a degree of utility, most applications, unfortunately, are ad hoc with no demonstration of stability. The stability proofs that do exist rely almost invariably on the universal approximation property for NN. However, in most real industrial control systems there are nonsmooth functions (piecewise continuous) for which approximation results in the literature are sparse or nonexistent. Examples of phenomena involving nonsmooth functions include, but are not limited to, deadzone, friction, and backlash. Though there do exist some results for piecewise continuous functions, traditional attempts to approximate jump functions using smooth activation functions require many NN nodes and many training iterations, and still do not yield very good results. It would therefore be advantageous to have the ability to estimate and compensate nonlinearities, including backlash nonlinearities, involving piecewise continuous functions with guaranteed close-loop stability.

The use of NN has accelerated in recent years in many areas, including feedback control applications. Particularly important in NN control are the universal function approximation capabilities of neural network systems. NN systems offer significant advantages over adaptive control, including no requirement for linearity in the parameters assumptions and no need to compute a regression matrix for each specific system. Dynamics inversion in continuous-time using NN has been proposed, where a NN is used for cancellation of the system inversion error. A continuous time dynamic inversion approach using NN for backlash compensation has also been proposed. A continuous time inverse dynamics approach using adaptive and robust control technique has been proposed as well. A preliminary approach using dynamic inversion for backlash compensation in discrete-time system has been proposed, but was incomplete in that its proof did not rigorously include the effects of a certain predictive filter needed to actually implement the technique.

Dynamic inversion is a form of backstepping, which has been extended to discrete-time systems with limited results. The difficulty with applying those results to discrete-time dynamic inversion is that a future value of a certain ideal control input is needed.

Certain problems facing the field enumerated above are not intended to be exhaustive but rather are among many which tend to impair the effectiveness of previously known estimation and compensation schemes. Other noteworthy problems may and do exist; however, those presented above are sufficient to demonstrate that methods of backlash compensation appearing in the art have not been altogether satisfactory.

SUMMARY OF THE INVENTION

This disclosure provides a discrete-time actuator nonlinearity compensator. In most applications, backlash models are either poorly known or completely unknown. Inverting the backlash nonlinearity even for known backlash models is not an easy task, since the nonlinearity appears in the feedforward path. This disclosure explains the design of an intelligent control system that cancels the unknown backlash nonlinearity, while still keeping the closed loop system stable. This allows faster and more precise control of industrial positioning systems in applications including, but not limited to, robotics, CNC machine tools, and vehicle suspension systems.

Backlash nonlinearities occur in almost all motion control systems. Unfortunately, it introduces errors. The problems are particularly exacerbated when the required accuracy and the speed of motion are high. There are many applications such as instrument differential gear trains and servomechanisms that require the complete elimination of backlash in order to function properly. The backlash compensator by dynamic inversion using a neural network (NN) of this disclosure may be applied in order to improve system performance and cancel the backlash effects. Potential markets are vast and include, but are not limited to, the auto industry, military applications, robotics, mechanical processes, and biomedical engineering.

This disclosure involves a discrete-time dynamic inversion compensation with a filtered prediction for backlash compensation in nonlinear systems. In one embodiment, the compensator uses the dynamic inversion technique with neural networks (NN) for inverting the backlash nonlinearity in the feedforward path. This disclosure shows how to tune the NN weights in discrete-time so that the unknown backlash parameters are learned on-line, resulting in a discrete-time adaptive backlash compensator. Using discrete-time nonlinear stability techniques, the tuning algorithm is shown to guarantee small tracking errors as well as bounded parameter estimates. Since the tracking error, backlash error and the parameter estimation error are weighted in the same Lyapunov function, no certainty equivalence assumption is needed.

The present disclosure extends dynamic inversion techniques to discrete-time systems by using a filtered prediction, and it shows how to use and tune a neural network for inverting backlash nonlinearity in the feedforward path. The techniques of this disclosure offer important improvements to controllers, neural net or otherwise, in that:

-   -   (1) The techniques extend the dynamic inversion technique to         discrete-time systems;     -   (2) This is a ‘model-free’ approach. A neural net is used for         inverting the backlash nonlinearity in the feedforward path so         that a mathematical model of the backlash is not needed;     -   (3) The techniques apply for a large class of actuator         nonlinearities, not only backlash;     -   (4) The neural network design algorithm is based on rigorous         mathematical stability proofs, and so shows how to guarantee         closed-loop stability and performance;     -   (5) Unlike standard discrete-time adaptive control, no         linear-in-the-parameters (LIP) or certainty of equivalence (CE)         assumption is required. This requires an exceedingly complex         proof, but obviates the need for any sort of LIP or CE         assumption. It also allows the parameter-tuning algorithm to be         derived during the proof process, not selected a priori in an ad         hoc manner;     -   (6) The tuning algorithms for the neural net weights are         innovative, and no preliminary off-line tuning is needed. The         weights may be tuned on-line, and the algorithms guarantee         stability of the controlled system; and     -   (7) The neural network weights are easily initialized so that         the neural net output is zero, and a proportional-derivative         (PD) control loop keeps the system stable initially until the         weights begin to learn.

The advantages and features of the present invention differentiate it from previously-known methodology. Some of these advantages and features include, but are not limited to, the following:

-   -   (1) Other techniques based on discrete-time adaptive control         require a certainty equivalence assumption, which often does not         hold in practice;     -   (2) Most backlash compensators using older control technology do         not have any performance or stability guarantees. This makes         their acceptance by industry questionable.     -   (3) Other modem backlash compensators that do not use neural         nets, e.g. those based on adaptive control, require a strong         ‘linear in the parameters assumption’ that does not often hold         for actual industrial systems. This restricts the types of         backlash nonlinearities that can be canceled.     -   (4) Other backlash compensation techniques based on neural         networks do not provide design algorithms based on mathematical         proofs that guarantee stability of the controlled system. They         use standard ‘backpropagation’ weight tuning, which cannot         provide stability in all situations.     -   (5) Other backlash compensation techniques based on neural         networks do not show how to initialize the weights to guarantee         performance.     -   (6) Other techniques based on dynamic inversion have been         developed for continuous-time systems, not for discrete-time         systems. A discrete-time formulation is needed for digital         control.

As shown in the Examples section of this disclosure, simulation results show that a NN backlash compensator according to the present invention may significantly reduce the degrading effect of backlash nonlinearity.

BRIEF DESCRIPTION OF THE DRAWINGS

The following drawings form part of the present specification and are included to further demonstrate certain aspects of the present invention. The invention may be better understood by reference to one or more of these drawings in combination with the detailed description of specific embodiments presented herein.

FIG. 1A shows a backlash model according to one embodiment of the present disclosure.

FIG. 1B shows backlash in mechanical connections according to one embodiment of the present disclosure.

FIG. 2 shows backlash inverse according to one embodiment of the present disclosure.

FIGS. 3A and 3B show backlash inverse decomposition according to one embodiment of the present disclosure.

FIG. 4 shows a discrete time neural network compensator for compensating backlash according to one embodiment of the present disclosure.

FIG. 5 illustrates data concerning a PD controller without backlash.

FIG. 6 illustrates data concerning a PD controller with backlash.

FIG. 7 illustrates data concerning a PD controller with backlash compensation according to one embodiment of the present disclosure.

DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS

This disclosure provides the complete solution for extending dynamics inversion to discrete-time systems by using a filtered prediction approach for backlash compensation. The general case of nonsymmetric backlash is treated. A rigorous design procedure is given that results in a PD tracking loop with an adaptive NN in the feedforward loop for dynamic inversion of the backlash nonlinearity. The NN feedforward compensator is adapted in such a way as to estimate on-line the backlash inverse. Unlike standard discrete-time adaptive control techniques, no certainty equivalence (CE) assumption is needed since the tracking error and the estimation error are weighted in the same Lyapunov function. Unlike previous conventional techniques, no linearity in the parameters is needed.

Background

General

Let R denote the real numbers, R^(n) denote the real n-vectors, R^(m×n) the real m×n matrices. Let S be a compact simply connected set of R^(n). With maps ƒ:S→R^(k), define C^(k)(S) as the space such that ƒ is continuous. We denote by ∥·∥ a suitable vector norm. Given a matrix A=[a_(ij)], A∈R^(n×m) the Frobenius norm is defined by

$\begin{matrix} {{{A}_{F}^{2} = {{{tr}\left( {A^{T}A} \right)} = {\sum\limits_{i,j}^{\;}\; a_{ij}^{2}}}},} & (1) \end{matrix}$ with tr( ) the trace operation. The associated inner product is (A,B)_(F)=tr(A^(T)B). The Frobenius norm ∥A∥_(F) ², which is denoted by ∥·∥ throughout this disclosure unless specified explicitly, is nothing but the vector 2-norm over the space defined by stacking the matrix columns into a vector, so that it is compatible with the vector 2-norm, that is, ∥Ax∥≦∥A∥·∥x∥.

DEFINITION 1: Given a dynamical system x(k+1)=ƒ(x(k),u(k)),y(k)=h(x(k)), where x(k) is a state vector, u(k) is the input vector and y(k) is the output vector. The solution is Globally Uniformly Ultimately Bounded (GUUB) if for all x(k₀)=x₀, there exists an ε>0 and a number N(ε,x₀) such that ∥x(k)∥<ε for all k≧k_(0+N).

Dynamics of an mn-th Order MIMO System

Consider an mnth-order multi-input and multi-output discrete-time system given by

$\begin{matrix} \begin{matrix} {{x_{1}\left( {k + 1} \right)} = {x_{2}(k)}} \\ \vdots \\ {{x_{n - 1}\left( {k + 1} \right)} = {x_{n}(k)}} \\ {{{x_{n}\left( {k + 1} \right)} = {{f\left( {x(k)} \right)} + {\tau(k)} + {d(k)}}},} \end{matrix} & (2) \end{matrix}$ where x(k)=[x₁(k),x₂(k) . . . , x_(n)(k)]^(T) with x_(i)(k)∈

^(n); i=1,2, . . . ,n, u(k)∈R^(m), and d(k)∈R^(m) denotes a disturbance vector acting on the system at the instant k with ∥d(k)∥≦d_(M) a known constant. The actuator output τ(k) is related to the control input u(k) through the backlash nonlinearity. τ(k)=Backlash(u(k)) as discussed in the next section. Given a desired trajectory x_(nd)(k) and its delayed values, define the tracking error as e _(n)(k)=x _(n)(k)−x _(nd)(k).  (3) It is typical in robotics to define a so-called the filtered tracking error, as r(k)∈R^(m), and given by r(k)=e _(n)(k)+λ₁ e _(n−1)(k)+ . . . +λ_(n−1) e ₁(k),  (4) where e_(n−1)(k), . . . , e₁(k) are the delayed values of the error e_(n)(k), and λ₁, . . . , λ_(n−1) are constant matrices selected so that |z^(n−1)+λ₁z^(n−2)+ . . . +λ_(n−1)| is stable or Hurwitz (i.e. e_(n)(k)→0 exponentially as r(k)→0). Equation (4) can be further expressed as r(k+1)=e _(n)(k+1)+λ₁ e _(n−1)(k+1)+ . . . +λ_(n−1) e ₁(k+1).  (5) Using Eq. (2) in Eq. (5), the dynamics of the mn-th order MIMO system can be written in terms of the tracking error as r(k+1)=f(x(k))−x _(nd)(k+1)+λ₁ e _(n−1)(k)+ . . . +λ_(n−1) e ₁(k)+τ(k)+d(k).  (6) Neural Networks

Given x∈

^(N), a one-layer feedforward NN has a net output given by

$\begin{matrix} {{{y_{i} = {\sum\limits_{j = 1}^{N_{h}}\;\left\lbrack {{w_{ij}{\varphi(x)}} + \theta_{wi}} \right\rbrack}};\mspace{31mu}{i = 1}},\ldots\;,m} & (7) \end{matrix}$ with φ(·) the activation functions and w_(ij) the output-layer weights. The θ_(wi),i=1,2, . . . , are threshold offsets, and N_(h) is the number of hidden-layer neurons. In the NN we should like to adapt the weights and thresholds on-line in real time to provide suitable performance of the net. That is, the NN should exhibit “on-line learning while controlling” behavior. The output of a one-layer can be also expressed in matrix form as y(x)=W ^(T)φ(x),  (8) where 1 is included as the first element of φ(x) in order to incorporate the thresholds θ_(wi) as the first column of W^(T). Thus, any tuning of W includes tuning of the thresholds as well.

One property of NN we are concerned with for control and estimation purposes is the function approximation property. Let ƒ(x) be a smooth function from

^(n)→

^(m). Then it can be shown that, as long as x is restricted to a compact set S∈

^(n), for some sufficiently large number of hidden-layer neurons N_(h), there exist weights and thresholds such that one has ƒ(x)=W ^(T)φ(x)+ε(x).  (9) This equation means that a neural network can approximate any continuous function in a compact set. The value of ε(x) is called the neural network functional approximation error. In fact, for any choice of a positive number ε_(N), one can find a neural network such that ε(x)≦ε_(N) for all x∈S. For suitable NN approximation properties, φ(x) must be a basis:

DEFINITION 2: Let S be a compact simply connected set of

^(n) and let φ(x):S→

^(N) _(h) be integrable and bounded. Then φ(x) is said to provide a basis for C^(m)(S) if:

-   -   1. A constant function on S can be expressed as (7) for finite         N_(h).     -   2. The functional range of neural network (7) is dense in         C^(m)(S) for countable N_(h).

It has been shown that the neural network approximation error ε(x) for one-layer NN is fundamentally bounded below by a term of the order (1/n)^(2/d), where n is the number of fixed basis functions and d is the dimension of the input to the NN. This does not limit the tracking performance in controllers of this disclosure because of the control system structure selected.

It is not straightforward to pick a basis φ(x). CMAC, RBF, and other structured NN approaches allow one to choose a basis by partitioning the compact set S. However, this can be tedious. If one selects y(x)=W ^(T)σ(V ^(T) x),  (10) with, for instance,

${\sigma(x)} = \frac{1}{1 + {\mathbb{e}}^{\alpha\; x}}$ the sigmoid, then it has been shown that σ((V^(T) _(x)) is a basis if V is selected randomly. Once selected, V is fixed and only W is tuned. Then, the only design parameter in constructing the 1-layer NN is the number of hidden layer neurons N_(h). A larger N_(h) results in a smaller ε(x). Backlash Nonlinearity and Backlash Inverse

Backlash nonlinearity is shown in FIG. 1, and the mathematical model for continuous time is known in the art. For the discrete-time case, one has

$\begin{matrix} {{\tau\left( {k + 1} \right)} = {{B\left( {{\tau(k)},{u(k)},{u\left( {k + 1} \right)}} \right)} = \left\{ {\begin{matrix} {{m \cdot {u\left( {k + 1} \right)}},} & \begin{matrix} {{{{if}\mspace{14mu}{u\left( {k + 1} \right)}} > {0\mspace{14mu}{and}\mspace{14mu}{u(k)}}} = {{m \cdot {\tau(k)}} - {m \cdot d_{+}}}} \\ {{{{if}\mspace{14mu}{u\left( {k + 1} \right)}} < {0\mspace{14mu}{and}\mspace{14mu}{u(k)}}} = {{m \cdot {\tau(k)}} - {m \cdot d_{-}}}} \end{matrix} \\ {0,} & {otherwise} \end{matrix}.} \right.}} & (11) \end{matrix}$ It can be seen that backlash is a first-order velocity driven dynamic system, with inputs u(k) and u(k+1), and state τ(k). Backlash contains its own dynamics, therefore its compensation requires the design of a dynamic compensator.

Whenever the motion u(k) changes its direction, the motion τ(k) is delayed from motion of u(k). One objective of a backlash compensator is to make this delay as small as possible, i.e. to make the throughput from u(k) to τ(k) be unity. The backlash precompensator needs to generate the inverse of the backlash nonlinearity. The backlash inverse function is shown in FIG. 2.

The dynamics of the NN backlash compensator is given by u(k+1)=B _(inv)(u(k), w(k), w(k+1)),  (12)

The backlash inverse characteristic shown in the FIG. 2 can be decomposed into two functions: a direct feedforward term plus an additional modified backlash inverse term as shown in FIG. 3. This decomposition allows design of a compensator that has a better structure than when a NN is used directly in the feedforward path.

Discrete Time NN Backlash Compensator

Portions of a discrete time NN backlash compensator according to one embodiment of this disclosure may be designed using backstepping techniques known in the art. In this section it is shown how to tune the NN weights on-line so that the tracking error is guaranteed small and all internal states are bounded. It is assumed that the actuator output τ(k) is measurable. Unlike conventional techniques, no linearity in the parameters assumption is needed.

Dynamics of Nonlinear System with Backlash

Equation (2) is in the companion form and represents a large class of multi-input multi-output (MINO) nonlinear systems. The overall system dynamics consist of (2) and the backlash dynamics (11).

The following assumptions are needed and they are true in every practical situation and are standard in the existing literature.

Assumption 1 (Bounded disturbance): The unknown disturbance satisfies ∥d(k)∥≦d_(M), with d_(M) a known positive constant.

Assumption 2 (Bounded estimation error): The nonlinear function is assumed to be unknown, but a fixed estimate {circumflex over (ƒ)}(x(k)) is assumed known such that the functional estimation error, {tilde over (ƒ)}(x(k))=ƒ(x(k))−{circumflex over (f)}(x(k)), satisfies ∥{tilde over (ƒ)}(x(k))∥≦ƒ_(M)(x(k)), for some known bounding function ƒ_(M)(x(k)).

This assumption is not unreasonable, as in practical systems the bound ƒ_(M)(x(k)) can be computed knowing the upper bound on payload masses, frictional effects, and so on.

Assumption 3 (Bounded desired trajectories): The desired trajectory is bounded in the sense, for instance that

${\begin{matrix} \begin{matrix} \begin{matrix} {x_{1d}(k)} \\ {x_{2d}(k)} \end{matrix} \\ \vdots \end{matrix} \\ {x_{nd}(k)} \end{matrix}} \leq {X_{d} \cdot}$ Backstepping Controller

A robust compensation scheme for unknown terms in ƒ(x(k)) is provided by selecting the tracking controller τ_(des)(k)=K _(v) ·r(k)−{circumflex over (ƒ)}(x(k))+x _(nd)(k+1)−λ₁ ·e _(n−1)(k)−λ₂ ·e _(n−2)(k)− . . . λ_(n−1) ·e ₁(k),  (13) with {circumflex over (ƒ)}(x(k)) an estimate for the nonlinear terms ƒ(x(k)). The feedback gain matrix K_(v)>0 is often selected diagonal. The problem of finding {circumflex over (ƒ)}(x(k)) is not the main concern of this disclosure, and it may be found by methods known in the art. This function ƒ(x(k)) can be estimated, for instance, using adaptive control techniques or neural network controllers.

Using (13) as a control input, the system dynamics in (6) can be rewritten as r(k+1)=K _(v) ·r(k)+{tilde over (ƒ)}(x(k))+d(k).  (14)

The next theorem is the first step in the backstepping design; and it shows that the desired control law (13) will keep the filtered tracking error small if there is no backlash.

Theorem 1 (Control Law for Outer Tracking Loop)

Consider the system given by equation (2). Assume that Assumptions 1 and 2 hold, and let the control action by provided by (13) with 0<K_(v)<I being a design parameter.

Then the filtered tracking error r(k) is UUB.

Proof

Let us consider the following Lyapunov function candidate L ₁(k)=r(k)^(T) r(k).  (15) The first difference is

$\begin{matrix} \begin{matrix} {{\Delta\;{L_{1}(k)}} = {{{{r\left( {k + 1} \right)}^{T}{r\left( {k + 1} \right)}} - {{r(k)}^{T}{r(k)}}} =}} \\ {= {{\left( {{K_{v} \cdot {r(k)}} + {\overset{\sim}{f}\left( {x(k)} \right)} + {d(k)}} \right)^{T}\left( {{K_{v} \cdot {r(k)}} + {\overset{\sim}{f}\left( {x(k)} \right)} + {d(k)}} \right)} - {{r(k)}^{T}{{r(k)}.}}}} \\ {{\Delta\;{L_{1}(k)}\mspace{14mu}{is}\mspace{14mu}{negative}\mspace{14mu}{if}\mspace{14mu}{{{K_{v}{r(k)}} + {\overset{\sim}{f}\left( {x(k)} \right)} + {d(k)}}}} \leq {{K_{v_{\max}}{{r(k)}}} + f_{M} + d_{M}} < {{r(k)}}} \\ {\left. \Rightarrow{{\left( {1 - K_{v_{\max}}} \right){{r(k)}}} > {f_{M} + d_{M}}} \right.,} \end{matrix} & (16) \end{matrix}$ which is true as long as

$\begin{matrix} {{{r(k)}} > {\frac{f_{M} + d_{M}}{1 - K_{v\mspace{11mu}\max}}.}} & (17) \end{matrix}$

Therefore, ΔL₁(k) is negative outside a compact set. According to standard Lyapunov theory extension, this demonstrates the UUB of r(k).

NN Backlash Compensation using Dynamic Inversion

Theorem 1 gives the control law that guarantees stability in term of the filtered tracking error, assuming that no nonlinearity besides the system nonlinear function plus some bounded external disturbances are present. In the presence of unknown backlash nonlinearity, the desired and actual value of the control signal τ(k) will be different. A dynamics inversion technique by neural networks may be used for compensation of the inversion error. This is a form of backstepping.

The actuator output given by (13) is the desired signal. The complete error system dynamics can be found defining the error {tilde over (τ)}(k)=τ_(des)(k)−τ(k).  (18) Using the desired control input (13), under the presence of unknown backlash the system dynamics (6) can be rewritten as r(k+1)=K _(v) ·r(k)+{tilde over (ƒ)}(x(k))+d(k)−{tilde over (τ)}(k).  (19) Evaluating (18) at the following time interval {tilde over (τ)}(k+1)=τ_(des)(k+1)−τ(k+1)=τ_(des)(k+1)−B(τ(k),u(k),u(k+1)).  (20) which together with (19) represents the complete system error dynamics. The dynamics of the backlash nonlinearity can be written as: τ(k+1)=φ(k),  (21) φ(k)=B(τ(k),u(k),u(k+1)),  (22) where φ(k) is a pseudo-control input. In the case of known backlash, the ideal backlash inverse is given by u(k+1)=B ⁻¹(u(k),τ(k),φ(k)).  (23) Since the backlash and therefore its inverse are not known, one can only approximate the backlash inverse as û(k+1)={circumflex over (B)} ⁻¹(u(k),τ(k),φ(k)).  (24) The backlash dynamics can now be written as

$\begin{matrix} \begin{matrix} {{\tau\left( {k + 1} \right)} = {B\left( {{\tau(k)},{\hat{u}(k)},{\hat{u}\left( {k + 1} \right)}} \right)}} \\ {{= {{\hat{B}\left( {{\tau(k)},{\hat{u}(k)},{\hat{u}\left( {k + 1} \right)}} \right)} + {\overset{\sim}{B}\left( {{\tau(k)},{\hat{u}(k)},{\hat{u}\left( {k + 1} \right)}} \right)}}},} \\ {= {{\hat{\varphi}(k)} + {\overset{\sim}{B}\left( {{\tau(k)},{\hat{u}(k)},{\hat{u}\left( {k + 1} \right)}} \right)}}} \end{matrix} & (25) \end{matrix}$ where φ(k)={circumflex over (B)}(τ(k),û(k),û(k+1)) and therefore its inverse is given by û(k+1)={circumflex over (B)}⁻¹(τ(k),û(k),φ(k)). The unknown function {tilde over (B)}(τ(k),û(k),û(k+1)), which represents the backlash inversion error, will be approximated using a neural network.

In order to design a stable closed-loop system with backlash compensation, one selects a nominal backlash inverse û(k+1)={circumflex over (φ)}(k) and pseudo-control input as {circumflex over (φ)}(k)=−K _(b){tilde over (τ)}(k)+τ_(filt)(k)+Ŵ(k)^(T)σ(V ^(T) x _(nn)(k)),  (26) where K_(b)>0 is a design parameter, and τ_(filt) is a discrete-time filtered version of τ_(des). τ_(filt) is a filtered prediction that approximates τ_(des)(k+1), and is obtained using the discrete-time filter az/(z+a) as shown in FIG. 4. This is the equivalent of using a filtered derivative instead of a pure derivative in continuous-time dynamics inversion, which is standard in industrial control systems. The filter dynamics shown in FIG. 4 can be written as

$\begin{matrix} {{{\tau_{filt}(k)} = {{- \frac{\tau_{filt}\left( {k + 1} \right)}{a}} + {\tau_{des}\left( {k + 1} \right)}}},} & (27) \end{matrix}$ where a is a design parameter. It can be seen that when the filter parameter a is large enough we have τ_(flit)(k)≈τ_(des)(k+1). The mismatch term

$- \frac{\tau_{filt}\left( {k + 1} \right)}{a}$ can be approximated along with the backlash inversion error using the NN.

Based on the NN approximation property, the backlash inversion plus the filter error dynamics can be represented as

$\begin{matrix} {{{{\overset{\sim}{B}\left( {{\tau(k)},{\hat{u}(k)},{\hat{u}\left( {k + 1} \right)}} \right)} + \frac{\tau_{filt}\left( {k + 1} \right)}{a}} = {{{W(k)}^{T}{\sigma\left( {V^{T}{x_{nn}(k)}} \right)}} + {ɛ(k)}}},} & (28) \end{matrix}$ where the NN input vector is chosen to be x_(nn)(k)=[1 r(k)^(T) _(x) _(d)(k)^(T){tilde over (τ)}(k)^(T)τ(k)^(T)]^(T), and ε(k) represents the NN approximation error. It can be seen that the first layer of weights is not time dependant since it is selected randomly at initial time to provide a basis and then it is kept constant through the tuning process.

Define the NN weight estimation error as {tilde over (W)}(k)=W(k)−Ŵ(k),  (29) where Ŵ(k) is the estimate of the ideal NN weights W(k).

Using the proposed controller shown in FIG. 4, the error dynamics can be written as

$\begin{matrix} {\begin{matrix} {{\overset{\sim}{\tau}\left( {k + 1} \right)} = {{\tau_{des}\left( {k + 1} \right)} - {\hat{\varphi}(k)} + {\overset{\sim}{B}\left( {{\tau(k)},{\hat{u}(k)},{\hat{u}\left( {k + 1} \right)}} \right)}}} \\ {= {{K_{b}{\overset{\sim}{\tau}(k)}} + \frac{\tau_{filt}\left( {k + 1} \right)}{a} - {{\hat{W}(k)}^{T}{\sigma\left( {V^{T}{x_{nn}(k)}} \right)}} +}} \\ {\overset{\sim}{B}\left( {{\tau(k)},{\hat{u}(k)},{\hat{u}\left( {k + 1} \right)}} \right)} \\ {= {{K_{b}{\overset{\sim}{\tau}(k)}} - {{\hat{W}(k)}^{T}{\sigma\left( {V^{T}{x_{nn}(k)}} \right)}} + {{W(k)}^{T}{\sigma\left( {V^{T}{x_{nn}(k)}} \right)}} + {ɛ(k)}}} \end{matrix},} & (30) \end{matrix}$ Using (29), {tilde over (τ)}(k+1)=K _(b){tilde over (τ)}(k)+{tilde over (W)}(k)^(T)σ(V ^(T) x _(nn)(k))+ε(k).  (31) The next theorem is an important result, which shows how to tune the neural network weights so the tracking error r(k) and backlash estimation error {tilde over (τ)}(k) achieve small values while the NN weights estimation errors {tilde over (W)}(k) are bounded. Theorem 2 (Control Law for Backstepping Loop)

Consider the system given by (2). Provided that assumptions 1, 2, and 3 hold, let the control action {circumflex over (φ)}(k) by provided by (26) with K_(b)>0 being a design parameter.

Let u(k+1)=φ(k), and the estimated NN weights be provided by the NN tuning law Ŵ(k+1)=Ŵ(k)+ασ(k)r(k+1)^(T)+ασ(k){tilde over (τ)}(k+1)^(T) −Γ∥I−ασ(k)σ(k)^(T) ∥Ŵ(k).  (32) where α>0 is a constant learning rate parameter or adaptation gain, Γ>0 is a design parameter, and for simplicity purposes σ(V^(T) _(x) _(nn)(k)) is represented as σ(k). Then, the filtered tracking error r(k), the backlash estimation error {tilde over (τ)}(k), and the NN weight estimation error {tilde over (W)}(k) are UUB, provided the following conditions hold: 1) 0<ασ(k)^(T)σ(k)<½,  (33) 2) 0<Γ<1,  (34)

$\begin{matrix} {{{\left. 3 \right)\mspace{14mu} 0} < K_{v} < {I\mspace{14mu}{and}\mspace{14mu} K_{vmax}} < \frac{1}{\sqrt{\eta + 2}}},} & (35) \end{matrix}$ where β=K _(v) ⁻¹(2I−K _(v))+(1−ασ(k)^(T)σ(k)K _(v) ^(−T) K _(v) ⁻¹>0.  (36) ρ=(1−ασ(k)^(T)σ(k))I−β ⁻¹(ασ(k)^(T)σ(k)+Γ∥I−ασ(k)σ(k)^(T)∥)²>0.  (37) η=(1+ασ(k)^(T)σ(k))I+ρ ⁻¹(ασ(k)^(T)σ(k)+Γ∥I−ασ(k)σ(k)^(T)∥)²>0.  (38) Theorem Proof: See Appendix B.

Note that condition (36) is true because of (33) and (35). Note also that (38) is satisfied because of conditions (33) and (37). A proof for condition (37) is given in Appendix A.

Remarks

It is important to note that in this theorem, there is no certainty equivalence (CE) assumption, in contrast to standard work in discrete-time adaptive control. In the latter, a parameter identifier is first selected and the parameter estimation errors are assumed small. In the tracking proof, it is assumed that the parameter estimates are exact (the CE assumption), and a Lyapunov function is selected that weights only the tracking error to demonstrate close-loop stability and tracking performance. By contrast, in this disclosure, the Lyapunov function in Appendix B is of the form

$\begin{matrix} {{{J(k)} = {{{\left\lbrack {{r(k)} + {\overset{\sim}{\tau}(k)}} \right\rbrack^{T} \cdot \left\lbrack {{r(k)} + {\overset{\sim}{\tau}(k)}} \right\rbrack} + {{r(k)}^{T}{r(k)}} + {\frac{1}{\alpha}{tr}\left\{ {{\overset{\sim}{W}(k)}^{T} \cdot {\overset{\sim}{W}(k)}} \right\}}} > 0}},} & \left( {B{.4}} \right) \end{matrix}$ which weights the tracking error r(k), backlash estimation error {tilde over (τ)}(k) and the NN weight estimation error {tilde over (W)}(k). This requires an exceedingly complex proof, but obviates the need for any sort of CE assumption. It also allows the parameter-tuning algorithm to be derived during the proof process, not selected a priori in an ad hoc manner.

The third term in (32) is a discrete-time version of Narendra's e-mod, which is required to provide robustness due to the coupling in the proof between tracking error, backlash error terms and weight estimation error terms in the Lyapunov function. This is called a ‘forgetting term’ in NN weight-tuning algorithms. These are required in that context to prevent parameter overtraining.

The following examples are included to demonstrate specific embodiments of the present disclosure. Those of skill in the art should, in light of the present disclosure, appreciate that many changes may be made in specific embodiments that are disclosed and still obtain a like or similar result without departing from the spirit and scope of the invention.

EXAMPLE 1

Simulation Results

In this section, a discrete-time NN backlash compensator according to an embodiment of this disclosure is simulated on a digital computer. It is found to be very efficient at canceling the deleterious effects of actuator backlash.

Simulation

We simulate the response for the known plant with input backlash, both with and without the NN compensator. Consider the following nonlinear plant x ₁(k+1)=x ₂(k),

${x_{2}\left( {k + 1} \right)} = {{- {\frac{3}{16}\left\lbrack \frac{x_{1}(k)}{1 + {x_{2}^{2}(k)}} \right\rbrack}} + {x_{2}(k)} + {{u(k)}.}}$

The deadband widths for the backlash nonlinearity were selected as d+=d−=0.2 and the slope as m=0.5.

Trajectory Tracking

In this subsection we simulate the trajectory tracking performance of the system for sinusoidal reference signals. The reference signal used was selected to be x _(d)(k)=sin(w·t _(k)+φ), w=0.5, φ=π/2.

The sampling period was selected as T=0.001 s.

FIG. 5 shows the system response without backlash using a standard PD controller. The PD controller does a good job on the tracking which is achieved at about 2 seconds. FIG. 6 shows the system response with input backlash. The system backlash destroys the tracking and the PD controller by itself is not capable of compensating for that. FIG. 7 shows the same situation but using the discrete-time NN backlash compensator of the present disclosure. The backlash compensator takes care of the system backlash and the tracking is achieved in less than 0.5 seconds.

Appendix A

Note: For simplicity purposes, in this appendix, the k sub-index is omitted. So, every variable has a k sub-index unless specified otherwise. This statement is valid only for the proofs shown in Appendices A and B.

Proof of Condition (37).

Because of condition (33), we have that

${\left( {1 - {\alpha\;\sigma^{T}\sigma}} \right)I} > {\frac{1}{2}{I.}}$ Also using (33), (34) we have that

$\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;\sigma\;\sigma^{T}}}}}} \right)^{2} < {\frac{1}{4}I}$ Using (35) we have that β>I (i.e., β⁻¹<I). Then we can conclude that

${\beta^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;\sigma\;\sigma^{T}}}}}} \right)}^{2} < {\frac{1}{4}{I.}}$ Finally, using this last result we can show that

$\rho = {{{\left( {1 - {\alpha\;\sigma^{T}\sigma}} \right)I} - {\beta^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;\sigma\;\sigma^{T}}}}}} \right)}^{2}} > {\frac{1}{4}I} > 0.}$ Appendix B Proof of Theorem 2 For simplicity purposes let us rewrite the system dynamics as r _(k+1) =K _(v) ·r+D−{tilde over (τ)}.  (B.1) where D={tilde over (ƒ)}+d. And let us rewrite the backlash dynamics as {tilde over (τ)}_(k+1) =K _(b){tilde over (τ)}+{tilde over (W)} ^(T)σ(V ^(T) x _(nn))+ε.  (B.2) Select the Lyapunov function candidate

$\begin{matrix} {L = {{{{\begin{bmatrix} r^{T} & {\overset{\sim}{\tau}}^{T} \end{bmatrix}\begin{bmatrix} 2 & 1 \\ 1 & 1 \end{bmatrix}}\begin{bmatrix} r \\ \overset{\sim}{\tau} \end{bmatrix}} + {\frac{1}{\alpha}{tr}\;\left( {{\overset{\sim}{W}}^{T}\overset{\sim}{W}} \right)}} > 0.}} & \left( {B{.3}} \right) \end{matrix}$ This can be rewritten as

$\begin{matrix} {L = {{{2r^{T}r} + {2r^{T}\overset{\sim}{\tau}} + {{\overset{\sim}{\tau}}^{T}\overset{\sim}{\tau}} + {\frac{1}{\alpha}{tr}\;\left( {{\overset{\sim}{W}}^{T}\overset{\sim}{W}} \right)}} = {L_{1} + L_{2} + L_{3} + {L_{4}.}}}} & \left( {B{.4}} \right) \end{matrix}$ Taking the first difference

$\begin{matrix} {{\Delta\; L_{1}} = {{{2\; r_{k + 1}^{T}r_{k + 1}} - {2r^{T}r}} = {{{{2\left\lbrack {{K_{v}r} + D - \overset{\sim}{\tau}} \right\rbrack}^{T}\left\lbrack {{K_{v}r} + D - \overset{\sim}{\tau}} \right\rbrack} - {2r^{T}r}} =}}} \\ {= {{{- 2}{r^{T}\left\lbrack {I - {K_{v}^{T}K_{v}}} \right\rbrack}r} + {4r^{T}K_{v}^{T}D} - {4r^{T}K_{v}^{T}\overset{\sim}{\tau}} + {2D^{T}D} - {4D^{T}\overset{\sim}{\tau}} + {2{\overset{\sim}{\tau}}^{T}{\overset{\sim}{\tau}.}}}} \\ {{\Delta\; L_{2}} = {{{2\; r_{k + 1}^{T}{\overset{\sim}{\tau}}_{k + 1}} - {2r^{T}\overset{\sim}{\tau}}} = {{2\left( {{K_{v}r} + D - \overset{\sim}{\tau}} \right)^{T}\left( {{K_{b}\overset{\sim}{\tau}} + {{\overset{\sim}{W}}^{T}\sigma} + ɛ} \right)} - {2r^{T}\overset{\sim}{\tau}}}}} \\ {= {{2r^{T}K_{v}^{T}K_{b}\overset{\sim}{\tau}} + {2r^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} + {2r^{T}K_{v}^{T}ɛ} + {2D^{T}K_{b}\overset{\sim}{\tau}} + {2D^{T}{\overset{\sim}{W}}^{T}\sigma} + {2D^{T}ɛ} - {2{\overset{\sim}{\tau}}^{T}K_{b}^{T}K_{b}\overset{\sim}{\tau}} +}} \\ {{{- 2}{\overset{\sim}{\tau}}^{T}{\overset{\sim}{W}}^{T}\sigma} - {2{\overset{\sim}{\tau}}^{T}ɛ} - {2r^{T}{\overset{\sim}{\tau}.}}} \\ {{\Delta\; L_{3}} = {{{{\overset{\sim}{\tau}}_{k + 1}^{T}{\overset{\sim}{\tau}}_{k + 1}} - {{\overset{\sim}{\tau}}^{T}\overset{\sim}{\tau}}} = {{\left( {{K_{b}\overset{\sim}{\tau}} + {{\overset{\sim}{W}}^{T}\sigma} + ɛ} \right)^{T}\left( {{K_{b}\overset{\sim}{\tau}} + {{\overset{\sim}{W}}^{T}\sigma} + ɛ} \right)} - {{\overset{\sim}{\tau}}^{T}\overset{\sim}{\tau}}}}} \\ {= {{{\overset{\sim}{\tau}}^{T}K_{b}^{T}K_{b}\overset{\sim}{\tau}} + {2{\overset{\sim}{\tau}}^{T}K_{b}^{T}{\overset{\sim}{W}}^{T}\sigma} + {2{\overset{\sim}{\tau}}^{T}K_{b}^{T}ɛ} + {\sigma^{T}\overset{\sim}{W}{\overset{\sim}{W}}^{T}\sigma} + {2ɛ^{T}{\overset{\sim}{W}}^{T}\sigma} + {ɛ^{T}ɛ} - {{\overset{\sim}{\tau}}^{T}\overset{\sim}{\tau.}}}} \\ {{\Lambda\; L_{4}} = {{\frac{1}{\alpha}{tr}\;\left( {{{\overset{\sim}{W}}_{k + 1}^{T}{\overset{\sim}{W}}_{k + 1}} - {{\overset{\sim}{W}}^{T}\overset{\sim}{W}}} \right)} = {\frac{1}{\alpha}{tr}\;\left( {\left( {W_{k + 1} - {\hat{W}}_{k + 1}} \right)^{T}\left( {W_{k + 1} - {\hat{W}}_{k + 1}} \right)\left( {{- {\overset{\sim}{W}}^{T}}\overset{\sim}{W}} \right)} \right.}}} \\ {= {\frac{1}{\alpha}{tr}\;{\left( {{{\hat{W}}_{k + 1}^{T}{\hat{W}}_{k + 1}} + {W^{T}W} - {2W^{T}{\hat{W}}_{k + 1}} - {{\overset{\sim}{W}}^{T}\overset{\sim}{W}}} \right).}}} \end{matrix}$ Select the tuning law Ŵ _(k+1) =Ŵ+ασ·r _(k+1) ^(T) +ασ·{tilde over (τ)} _(k+1) ^(T) −Γ∥I−α·σ·σ ^(T) ∥Ŵ. Then,

$\begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} {{\Delta\; L_{4}} = {\frac{1}{\alpha}{tr}\left\{ {{\left\lbrack {\hat{W} + {\alpha\;{\sigma\left( {r_{k + 1}^{T} + {\overset{\sim}{\tau}}_{k + 1}^{T}} \right)}} - {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}\hat{W}}} \right\rbrack^{T}\left\lbrack {\hat{W} + {\alpha\;{\sigma\left( {r_{k + 1}^{T} + {\overset{\sim}{\tau}}_{k + 1}^{T}} \right)}} - {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}\hat{W}}} \right\rbrack} +} \right.}} \\ {\left. {{{+ W^{T}}W} - {{\overset{\sim}{W}}^{T}\overset{\sim}{W}} - {2{W^{T}\left\lbrack {\hat{W} + {\alpha\;{\sigma\left( {r_{k + 1}^{T} + {\overset{\sim}{\tau}}_{k + 1}^{T}} \right)}} - {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}\hat{W}}} \right\rbrack}}} \right\}.} \end{matrix} \\ {= {\frac{1}{\alpha}{tr}\left\{ {{{\hat{W}}^{T}\hat{W}} + {2{\hat{W}}^{T}\alpha\;{\sigma \cdot r_{k + 1}^{T}}} + {2{\hat{W}}^{T}\alpha\;{\sigma \cdot {\overset{\sim}{\tau}}_{k + 1}^{T}}} - {2{\hat{W}}^{T}\Gamma{{I - {\alpha\;{\sigma \cdot \sigma^{T}}}}}\hat{W}} +} \right.}} \end{matrix} \\ {{{+ \alpha^{2}}r_{k + 1}\sigma^{T}{\sigma \cdot r_{k + 1}^{T}}} + {2\alpha^{2}r_{k + 1}\sigma^{T}{\sigma \cdot {\overset{\sim}{\tau}}_{k + 1}^{T}}} - {2\alpha\; r_{k + 1}\sigma^{T}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\hat{W}} +} \end{matrix} \\ {{{+ \alpha^{2}}{\overset{\sim}{\tau}}_{k + 1}\sigma^{T}{\sigma \cdot {\overset{\sim}{\tau}}_{k + 1}^{T}}} - {2\alpha\;{\overset{\sim}{\tau}}_{k + 1}\sigma^{T}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\hat{W}} + {\Gamma^{2}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}{\hat{W}}^{T}\hat{W}} + {W^{T}W} - {{\overset{\sim}{W}}^{T}\overset{\sim}{W}} +} \end{matrix} \\ \left. {{{- 2}W^{T}\hat{W}} - {2W^{T}\alpha\;{\sigma \cdot r_{k + 1}^{T}}} + {2W^{T}\alpha\;{\sigma \cdot {\overset{\sim}{\tau}}_{k + 1}^{T}}} + {2W^{T}\Gamma{{I - {\alpha\; \cdot \sigma \cdot \sigma^{T}}}}\hat{W}}} \right\} \end{matrix} \\ {= {{2r_{k + 1}^{T}{\hat{W}}^{T}\sigma} + {2{\overset{\sim}{\tau}}_{k + 1}^{T}{\hat{W}}^{T}\sigma} + {{\alpha \cdot r_{k + 1}^{T}}\sigma^{T}\sigma\; r_{k + 1}} + {2\alpha\;{\overset{\sim}{\tau}}_{k + 1}^{T}\sigma^{T}\sigma\; r_{k + 1}} +}} \end{matrix} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;{\sigma\sigma}^{T}}}}r_{k + 1}^{T}{\hat{W}}^{T}\sigma} + {\alpha{\overset{\sim}{\tau}}_{k + 1}^{T}\sigma^{T}{\sigma \cdot {\overset{\sim}{\tau}}_{k + 1}^{T}}} - {2\Gamma{{I - {\alpha \cdot \;{\sigma\sigma}^{T}}}}\;{\overset{\sim}{\tau}}_{k + 1}^{T}{\hat{W}}^{T}\sigma} +} \end{matrix} \\ {{{- 2}r_{k + 1}^{T}W^{T}\sigma} - {2{\overset{\sim}{\tau}}_{k + 1}^{T}W^{T}\sigma} + {\frac{1}{\alpha}{tr}\left\{ {{{\hat{W}}^{T}\hat{W}} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\hat{W}}^{T}\hat{W}} + {W^{T}W} - {{\overset{\sim}{W}}^{T}\overset{\sim}{W}} +} \right.}} \end{matrix} \\ \left. {{{- 2}W^{T}W} + {\Gamma^{2}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}{\hat{W}}^{T}\hat{W}} + {2W^{T}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\hat{W}}} \right\} \end{matrix} \\ {= {{2\left( {{r^{T}K_{v}^{T}} + D^{T} - {\overset{\sim}{\tau}}^{T}} \right){\hat{W}}^{T}\sigma} + {2\left( {{{\overset{\sim}{\tau}}^{T}K_{b}^{T}} + {\sigma^{T}\overset{\sim}{W}} + ɛ^{T}} \right){\hat{W}}^{T}\sigma}}} \end{matrix} \\ {{{{+ \alpha} \cdot \left( {{r^{T}K_{v}^{T}} + D^{T} - {\overset{\sim}{\tau}}^{T}} \right)}\sigma^{T}{\sigma\left( {{K_{v}r} + D - \overset{\sim}{\tau}} \right)}} +} \end{matrix} \\ {{{+ 2}\;{\alpha\left( {{{\overset{\sim}{\tau}}^{T}K_{b}^{T}} + {\sigma^{T}\overset{\sim}{W}} + ɛ^{T}} \right)}\sigma^{T}{\sigma\left( {{K_{v}r} + D - \overset{\sim}{\tau}} \right)}} +} \end{matrix} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\left( {{r^{T}K_{v}^{T}} + D^{T} - {\overset{\sim}{\tau}}^{T}} \right){\hat{W}}^{T}\sigma} +} \end{matrix} \\ {{{+ {\alpha\left( {{{\overset{\sim}{\tau}}^{T}K_{b}^{T}} + {\sigma^{T}\overset{\sim}{W}} + ɛ^{T}} \right)}}\sigma^{T}{\sigma \cdot \left( {{K_{b}\overset{\sim}{\tau}} + {{\overset{\sim}{W}}^{T}\sigma} + ɛ} \right)}} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\left( {{{\overset{\sim}{\tau}}^{T}K_{b}^{T}} + {\sigma^{T}\overset{\sim}{W}} + ɛ^{T}} \right){\hat{W}}^{T}\sigma} - {2\left( {{r^{T}K_{v}^{T}} + D^{T} - {\overset{\sim}{\tau}}^{T}} \right)W^{T}\sigma} +} \\ {{{- 2}\left( {{{\overset{\sim}{\tau}}^{T}K_{b}^{T}} + {\sigma^{T}\overset{\sim}{W}} + ɛ^{T}} \right)W^{T}\sigma} + {\frac{1}{\alpha}{tr}\left\{ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\hat{W}}^{T}\hat{W}} +} \right.}} \\ \left. {{{+ 2}W^{T}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\hat{W}} + {\Gamma^{2}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}{\hat{W}}^{T}\hat{W}}} \right\} \end{matrix}$

$\begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix} {{Combining}\mspace{14mu}{all}\mspace{14mu}{the}\mspace{14mu}{terms}} \\ {{\Delta\; L} = {{{- 2}{r^{T}\left\lbrack {I - {K_{v}^{T}K_{v}}} \right\rbrack}r} + {4r^{T}K_{v}^{T}D} - {4r^{T}K_{v}^{T}\overset{\sim}{\tau}} + {2D^{T}D} - {4D^{T}\overset{\sim}{\tau}} + {2{\overset{\sim}{\tau}}^{T}\overset{\sim}{\tau +}}}} \end{matrix} \\ {{{+ 2}r^{T}K_{v}^{T}K_{b}\overset{\sim}{\tau}} + {2r^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} + {2r^{T}K_{v}^{T}ɛ} + {2D^{T}K_{b}\overset{\sim}{\tau}} + {2D^{T}{\overset{\sim}{W}}^{T}\sigma} + {2D^{T}ɛ} - {2{\overset{\sim}{\tau}}^{T}K_{b}^{T}K_{b}\overset{\sim}{\tau}} +} \end{matrix} \\ {{{- 2}{\overset{\sim}{\tau}}^{T}{\overset{\sim}{W}}^{T}\sigma} - {2{\overset{\sim}{\tau}}^{T}ɛ} - {2r^{T}\overset{\sim}{\tau}} +} \end{matrix} \\ {{{\overset{\sim}{\tau}}^{T}K_{b}^{T}K_{b}\overset{\sim}{\tau}} + {2{\overset{\sim}{\tau}}^{T}K_{b}^{T}{\overset{\sim}{W}}^{T}\sigma} + {2{\overset{\sim}{\tau}}^{T}K_{b}^{T}ɛ} + {\sigma^{T}\overset{\sim}{W}{\overset{\sim}{W}}^{T}\sigma} + {2ɛ^{T}{\overset{\sim}{W}}^{T}\sigma} + {ɛ^{T}ɛ} - {{\overset{\sim}{\tau}}^{T}\overset{\sim}{\tau}} +} \end{matrix} \\ {{{+ 2}\left( {{r^{T}K_{v}^{T}} + D^{T} - {\overset{\sim}{\tau}}^{T}} \right){\overset{\sim}{W}}^{T}\sigma} + {2\left( {{{\overset{\sim}{\tau}}^{T}K_{b}^{T}} + {\sigma^{T}\overset{\sim}{W}} + ɛ^{T}} \right){\hat{W}}^{T}\sigma} +} \end{matrix} \\ {{{{+ \alpha} \cdot \left( {{r^{T}K_{v}^{T}} + D^{T} - {\overset{\sim}{\tau}}^{T}} \right)}\sigma^{T}{\sigma\left( {{K_{v}r} + D - \overset{\sim}{\tau}} \right)}} +} \end{matrix} \\ {{{+ 2}{\alpha \cdot \left( {{{\overset{\sim}{\tau}}^{T}K_{b}^{T}} + {\sigma^{T}\overset{\sim}{W}} + ɛ^{T}} \right)}\sigma^{T}{\sigma\left( {{K_{v}r} + D - \overset{\sim}{\tau}} \right)}} +} \end{matrix} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\left( {{r^{T}K_{v}^{T}} + D^{T} - {\overset{\sim}{\tau}}^{T}} \right){\overset{\sim}{W}}^{T}\sigma} +} \end{matrix} \\ {{{+ {\alpha\left( {{{\overset{\sim}{\tau}}^{T}K_{b}^{T}} + {\sigma^{T}\overset{\sim}{W}} + ɛ^{T}} \right)}}\sigma^{T}{\sigma \cdot \left( {{K_{b}\overset{\sim}{\tau}} + {{\overset{\sim}{W}}^{T}\sigma} + ɛ} \right)}} +} \end{matrix} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\left( {{{\overset{\sim}{\tau}}^{T}K_{b}^{T}} + {\sigma^{T}\overset{\sim}{W}} + ɛ^{T}} \right){\hat{W}}^{T}\sigma} - {2\left( {{r^{T}K_{v}^{T}} + D^{T} - {\overset{\sim}{\tau}}^{T}} \right)W^{T}\sigma} +} \end{matrix} \\ {{{- 2}\left( {{{\overset{\sim}{\tau}}^{T}K_{b}^{T}} + {\sigma^{T}\overset{\sim}{W}} + ɛ^{T}} \right)W^{T}\sigma} + {\frac{1}{\alpha}{tr}\left\{ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\hat{W}}^{T}\hat{W}} +} \right.}} \\ \left. {{{+ 2}W^{T}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\hat{W}} + {\Gamma^{2}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}{\hat{W}}^{T}\hat{W}}} \right\} \\ {Simplifying} \\ {{\Delta\; L} = {{{- 2}{r^{T}\left\lbrack {I - {K_{v}^{T}K_{v}}} \right\rbrack}r} + {4r^{T}K_{v}^{T}D} - {4r^{T}K_{v}^{T}\overset{\sim}{\tau}} + {2D^{T}D} - {4D^{T}\overset{\sim}{\tau}} + {{\overset{\sim}{\tau}}^{T}\overset{\sim}{\tau +}}}} \\ {{{+ 2}r^{T}K_{v}^{T}K_{b}\overset{\sim}{\tau}} + {2r^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} + {2r^{T}K_{v}^{T}ɛ} + {2D^{T}K_{b}\overset{\sim}{\tau}} + {2D^{T}{\overset{\sim}{W}}^{T}\sigma} + {2D^{T}ɛ} - {{\overset{\sim}{\tau}}^{T}K_{b}^{T}K_{b}\overset{\sim}{\tau}} +} \\ {{{- 2}{\overset{\sim}{\tau}}^{T}{\overset{\sim}{W}}^{T}\sigma} - {2{\overset{\sim}{\tau}}^{T}ɛ} - {2r^{T}\overset{\sim}{\tau}} + {2{\overset{\sim}{\tau}}^{T}K_{b}^{T}{\overset{\sim}{W}}^{T}\sigma} + {2{\overset{\sim}{\tau}}^{T}K_{b}^{T}ɛ} + {\sigma^{T}\overset{\sim}{W}{\overset{\sim}{W}}^{T}\sigma} + {2ɛ^{T}{\overset{\sim}{W}}^{T}\sigma} + {ɛ^{T}ɛ} +} \\ {{{- 2}\left( {{r^{T}K_{v}^{T}} + D^{T} - {\overset{\sim}{\tau}}^{T}} \right){\overset{\sim}{W}}^{T}\sigma} - {2\left( {{{\overset{\sim}{\tau}}^{T}K_{b}^{T}} + {\sigma^{T}\overset{\sim}{W}} + ɛ^{T}} \right){\overset{\sim}{W}}^{T}\sigma} +} \\ {{{{+ \alpha} \cdot \left( {{r^{T}K_{v}^{T}} + D^{T} - {\overset{\sim}{\tau}}^{T}} \right)}\sigma^{T}{\sigma\left( {{K_{v}r} + D - \overset{\sim}{\tau}} \right)}} + {2{\alpha\left( {{{\overset{\sim}{\tau}}^{T}K_{b}^{T}} + {\sigma^{T}\overset{\sim}{W}} + ɛ^{T}} \right)}\sigma^{T}{\sigma\left( {{K_{v}r} + D - \overset{\sim}{\tau}} \right)}} +} \\ {{{- 2}\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}\left( {{r^{T}K_{v}^{T}} + D^{T} - {\overset{\sim}{\tau}}^{T}} \right)\left( {W - \overset{\sim}{W}} \right)^{T}\sigma} + {{\alpha\left( {{{\overset{\sim}{\tau}}^{T}K_{b}^{T}} + {\sigma^{T}\overset{\sim}{W}} + ɛ^{T}} \right)}\sigma^{T}\sigma\;\left( {{K_{b}\overset{\sim}{\tau}} + {{\overset{\sim}{W}}^{T}\sigma} + ɛ} \right)} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\left( {{{\overset{\sim}{\tau}}^{T}K_{b}^{T}} + {\sigma^{T}\overset{\sim}{W}} + ɛ^{T}} \right)\left( {W - \overset{\sim}{W}} \right)^{T}\sigma} + {\frac{1}{\alpha}{tr}\left\{ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\hat{W}}^{T}\hat{W}} +} \right.}} \\ \left. {{{+ 2}W^{T}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\hat{W}} + {\Gamma^{2}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}{\hat{W}}^{T}\hat{W}}} \right\} \\ {{Multiplying}\mspace{14mu}{out}\mspace{14mu}{terms}} \\ {{\Delta\; L} = {{{- 2}{r^{T}\left\lbrack {I - {K_{v}^{T}K_{v}}} \right\rbrack}r} + {4r^{T}K_{v}^{T}D} - {4r^{T}K_{v}^{T}\overset{\sim}{\tau}} + {2D^{T}D} - {4D^{T}\overset{\sim}{\tau}} + {{\overset{\sim}{\tau}}^{T}\overset{\sim}{\tau}} +}} \\ {{2r^{T}K_{v}^{T}K_{b}\overset{\sim}{\tau}} + {2r^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} + {2r^{T}K_{v}^{T}ɛ} + {2D^{T}K_{b}\overset{\sim}{\tau}} + {2D^{T}{\overset{\sim}{W}}^{T}\sigma} + {2D^{T}ɛ} - {{\overset{\sim}{\tau}}^{T}K_{b}^{T}K_{b}\overset{\sim}{\tau}} +} \\ {{{- 2}{\overset{\sim}{\tau}}^{T}{\overset{\sim}{W}}^{T}\sigma} - {2{\overset{\sim}{\tau}}^{T}ɛ} - {2r^{T}\overset{\sim}{\tau}} + {2{\overset{\sim}{\tau}}^{T}K_{b}^{T}{\overset{\sim}{W}}^{T}\sigma} + {2{\overset{\sim}{\tau}}^{T}K_{b}^{T}ɛ} + {\sigma^{T}\overset{\sim}{W}{\overset{\sim}{W}}^{T}\sigma} + {2ɛ^{T}{\overset{\sim}{W}}^{T}\sigma} + {ɛ^{T}ɛ} +} \\ {{{- 2}r^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} - {2D^{T}{\overset{\sim}{W}}^{T}\sigma} + {2{\overset{\sim}{\tau}}^{T}{\overset{\sim}{W}}^{T}\sigma} - {2{\overset{\sim}{\tau}}^{T}K_{b}^{T}{\overset{\sim}{W}}^{T}\sigma} - {2\sigma^{T}\overset{\sim}{W}{\overset{\sim}{W}}^{T}\sigma} - {2ɛ^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{+ \alpha}\; r^{T}K_{v}^{T}\sigma^{T}\sigma\; K_{v}r} + {2\alpha\; r^{T}K_{v}^{T}\sigma^{T}\sigma\; D} - {2\alpha\; r^{T}K_{v}^{T}\sigma^{T}\sigma\overset{\sim}{\tau}} + {\alpha\; D^{T}\sigma^{T}\sigma\; D} - {2\alpha\; D^{T}\sigma^{T}\sigma\overset{\sim}{\tau}} +} \\ {{{+ \alpha}{\overset{\sim}{\tau}}^{T}\sigma^{T}\sigma\overset{\sim}{\tau}} + {2\alpha{\overset{\sim}{\tau}}^{T}K_{b}^{T}\sigma^{T}\sigma\; K_{v}r} + {2\alpha\;{\overset{\sim}{\tau}}^{T}K_{b}^{T}\sigma^{T}\sigma\; D} - {2\alpha{\overset{\sim}{\tau}}^{T}K_{b}^{T}\sigma^{T}\sigma\overset{\sim}{\tau}} +} \\ {{{+ 2}{\alpha\sigma}^{T}\overset{\sim}{W}\sigma^{T}\sigma\; K_{v}r} + {2{\alpha\sigma}^{T}\overset{\sim}{W}\sigma^{T}\sigma\; D} - {2\alpha{\overset{\sim}{\tau}}^{T}\overset{\sim}{W}\sigma^{T}\sigma\overset{\sim}{\tau}} + {2\;{\alpha ɛ}^{T}\sigma^{T}\sigma\; K_{v}r}\; + {2\alpha\; ɛ^{T}\sigma^{T}\sigma\; D} +} \\ {{{- 2}\;{\alpha ɛ}^{T}\sigma^{T}\sigma\overset{\sim}{\tau}} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}r^{T}K_{v}^{T}W^{T}\sigma} + {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}r^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}D^{T}W^{T}\sigma} + {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}D^{T}{\overset{\sim}{W}}^{T}\sigma} + {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\overset{\sim}{\tau}}^{T}W^{T}\sigma} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\overset{\sim}{\tau}}^{T}{\overset{\sim}{W}}^{T}\sigma} + {\alpha{\overset{\sim}{\tau}}^{T}K_{b}^{T}\sigma^{T}\sigma\; K_{b}\overset{\sim}{\tau}} + {2\alpha\;{\overset{\sim}{\tau}}^{T}K_{b}^{T}\sigma^{T}\sigma{\overset{\sim}{W}}^{T}\sigma} + {2\alpha{\overset{\sim}{\tau}}^{T}K_{b}^{T}\sigma^{T}{\sigma ɛ}} +} \\ {{{+ \alpha}\;\sigma^{T}\overset{\sim}{W}\sigma^{T}\sigma{\overset{\sim}{W}}^{T}\sigma} + {2\alpha\;\tau^{T}\overset{\sim}{W}\sigma^{T}\sigma\; ɛ} + {{\alpha ɛ}^{T}\sigma^{T}{\sigma \cdot ɛ}} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\overset{\sim}{\tau}}^{T}K_{b}^{T}W^{T}\sigma} +} \\ {{{+ 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\overset{\sim}{\tau}}^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\sigma^{T}\overset{\sim}{W}{\hat{W}}^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}ɛ^{T}W^{T}\sigma} +} \\ {{{+ 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}ɛ^{T}{\overset{\sim}{W}}^{T}\sigma} + {\frac{1}{\alpha}{tr}\left\{ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\hat{W}}^{T}\hat{W}} +} \right.}} \\ \left. {{{+ 2}W^{T}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\hat{W}} + {\Gamma^{2}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}{\hat{W}}^{T}\hat{W}}} \right\} \\ {Simplifying} \\ {{\Delta\; L} = {{{- {r^{T}\left\lbrack {{2I} - {\left( {2 + {\alpha\;\sigma^{T}\sigma}} \right)K_{v}^{T}K_{v}}} \right\rbrack}}r} + {2\left( {2 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}K_{v}^{T}D} + {\left( {2 + {\alpha\;\sigma^{T}\sigma}} \right)D^{T}D} +}} \\ {{{+ 2}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}K_{v}^{T}ɛ} + {\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)ɛ^{T}ɛ} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)ɛ^{T}D} +} \\ {{{+ {\overset{\sim}{\tau}}^{T}}\overset{\sim}{\tau}} - {{\overset{\sim}{\tau}}^{T}K_{b}^{T}K_{b}\overset{\sim}{\tau}} + {\alpha{\overset{\sim}{\tau}}^{T}K_{b}^{T}\sigma^{T}\sigma\; K_{b}\overset{\sim}{\tau}} + {\alpha{\overset{\sim}{\tau}}^{T}\sigma^{T}\sigma\;\overset{\sim}{\tau}} - {2\alpha{\overset{\sim}{\tau}}^{T}K_{b}^{T}\sigma^{T}\sigma\;\overset{\sim}{\tau}} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}K_{v}^{T}K_{b}\overset{\sim}{\tau}} +} \\ {{{- 2}r^{T}\;\overset{\sim}{\tau}} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)D^{T}K_{b}\overset{\sim}{\tau}} - {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right){\overset{\sim}{\tau}}^{T}ɛ} - {2\left( {2 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}K_{v}^{T}\overset{\sim}{\tau}} - {2\alpha\;\sigma^{T}\overset{\sim}{W}\sigma^{T}\sigma\;\overset{\sim}{\tau}} +} \\ {{{- 2}\left( {2 + {\alpha\;\sigma^{T}\sigma}} \right)D^{T}\overset{\sim}{\tau}} + {2\alpha{\overset{\sim}{\tau}}^{T}K_{b}^{T}\sigma^{T}\sigma\;{\overset{\sim}{W}}^{T}\sigma} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right){\overset{\sim}{\tau}}^{T}K_{b}^{T}ɛ} +} \\ {{{+ 2}{\alpha\sigma}^{T}\sigma\; r^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} - {\left( {1 - {\alpha\;\sigma^{T}\sigma}} \right)\sigma^{T}\overset{\sim}{W}{\overset{\sim}{W}}^{T}\sigma} + {2\alpha\;\sigma^{T}\sigma\; ɛ^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{+ 2}{\alpha\sigma}^{T}{\overset{\sim}{W}}^{T}\sigma\; D} + {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}D^{T}{\overset{\sim}{W}}^{T}\sigma} + {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}r^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}r^{T}K_{v}^{T}W^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}D^{T}W^{T}\sigma} + {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}ɛ^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}ɛ^{T}W^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\overset{\sim}{\tau}}^{T}K_{b}^{T}W^{T}\sigma} + {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\overset{\sim}{\tau}}^{T}K_{b}^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{+ 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\overset{\sim}{\tau}}^{T}W^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\overset{\sim}{\tau}}^{T}{\overset{\sim}{W}}^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\sigma^{T}\overset{\sim}{W}{\hat{W}}^{T}\sigma} +} \\ {{+ \frac{1}{\alpha}}{tr}\left\{ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\hat{W}}^{T}\hat{W}} + {2W^{T}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\hat{W}} + {\Gamma^{2}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}{\hat{W}}^{T}\hat{W}}} \right\}} \end{matrix}$

Pick K_(b)=(I+K_(v) ⁻¹)^(T)=I+K_(a) and define β=2K_(a)+(1−ασ^(T)σ)K_(a) ^(T)K_(a)−I>0 (condition (36)) which is true as long as K_(v) ⁻¹<I (condition (35)).

It can be seen that β>I and β is a diagonal matrix since K_(a) is diagonal.

$\begin{matrix} {{\Delta\; L} = {{{- {r^{T}\left\lbrack {{2I} - {\left( {2 + {\alpha\;\sigma^{T}\sigma}} \right)K_{v}^{T}K_{v}}} \right\rbrack}}r} + {2\left( {2 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}K_{v}^{T}D} + {\left( {2 + {\alpha\;\sigma^{T}\sigma}} \right)D^{T}D} +}} \\ {{{+ 2}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}K_{v}^{T}ɛ} + {\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)ɛ^{T}ɛ} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)ɛ^{T}D} +} \\ {{{- \left( {\beta + I} \right)}{\overset{\sim}{\tau}}^{T}\overset{\sim}{\tau}} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}{K_{v}^{T}\left( {I + K_{a}} \right)}\overset{\sim}{\tau}} - {2r^{T}\overset{\sim}{\tau}} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right){D^{T}\left( {I + K_{a}} \right)}\overset{\sim}{\tau}} +} \\ {{{- 2}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right){\overset{\sim}{\tau}}^{T}ɛ} - {2\left( {2 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}K_{v}^{T}\overset{\sim}{\tau}} - {2\alpha\;\sigma^{T}\overset{\sim}{W}\sigma^{T}\sigma\overset{\sim}{\tau}} - {2\left( {2 + {\alpha\;\sigma^{T}\sigma}} \right)D^{T}\overset{\sim}{\tau}} +} \\ {{{+ 2}\alpha{{\overset{\sim}{\tau}}^{T}\left( {I + K_{a}^{T}} \right)}\sigma^{T}\sigma{\overset{\sim}{W}}^{T}\sigma} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right){{\overset{\sim}{\tau}}^{T}\left( {I + K_{a}^{T}} \right)}ɛ} +} \\ {{{+ 2}\alpha\;\sigma^{T}\sigma\; r^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} - {\left( {1 - {\alpha\;\sigma^{T}\sigma}} \right)\;\sigma^{T}\overset{\sim}{W}{\overset{\sim}{W}}^{T}\sigma} + {2\alpha\;\sigma^{T}{\sigma ɛ}^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{+ 2}\alpha\;\sigma^{T}\overset{\sim}{W}\sigma^{T}\sigma\; D} + {2\;\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}D^{T}{\overset{\sim}{W}}^{T}\sigma} + {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}r^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}r^{T}K_{v}^{T}W^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}D^{T}W^{T}\sigma} + {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}ɛ^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}ɛ^{T}W^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\sigma^{T}\overset{\sim}{W}{\hat{W}}^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{{\overset{\sim}{\tau}}^{T}\left( {I + K_{a}^{T}} \right)}W^{T}\sigma} +} \\ {{{+ 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{{\overset{\sim}{\tau}}^{T}\left( {I + K_{a}^{T}} \right)}{\overset{\sim}{W}}^{T}\sigma} + {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\overset{\sim}{\tau}}^{T}W^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\overset{\sim}{\tau}}^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {\frac{1}{\alpha}{tr}\left\{ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\hat{W}}^{T}\hat{W}} + {2W^{T}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\hat{W}} + {\Gamma^{2}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}{\hat{W}}^{T}\hat{W}}} \right\}} \\ {{\Delta\; L} = {{{- {r^{T}\left\lbrack {{2I} - {\left( {2 + {\alpha\;\sigma^{T}\sigma}} \right)K_{v}^{T}K_{v}}} \right\rbrack}}r} + {2\left( {2 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}K_{v}^{T}D} + {\left( {2 + {\alpha\;\sigma^{T}\sigma}} \right)D^{T}D} +}} \\ {{{+ 2}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}K_{v}^{T}ɛ} + {\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)ɛ^{T}ɛ} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)ɛ^{T}D} +} \\ {{{- \left( {I + \beta} \right)}{\overset{\sim}{\tau}}^{T}{\tau 2}r^{T}K_{v}^{T}\overset{\sim}{\tau}} + {2\alpha\;\sigma^{T}\sigma\; r^{T}\overset{\sim}{\tau}} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)D^{T}K_{a}\overset{\sim}{\tau}} - {2D^{T}\overset{\sim}{\tau}} +} \\ {{2\alpha{\overset{\sim}{\tau}}^{T}K_{a}^{T}\sigma^{T}\sigma{\overset{\sim}{W}}^{T}\sigma} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right){\overset{\sim}{\tau}}^{T}K_{a}} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\overset{\sim}{\tau}}^{T}K_{a}^{T}W^{T}\sigma} +} \\ {{2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\overset{\sim}{\tau}}^{T}K_{a}^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{+ 2}\alpha\;\sigma^{T}\sigma\; r^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} - {\left( {1 - {\alpha\;\sigma^{T}\sigma}} \right)\;\sigma^{T}\overset{\sim}{W}{\overset{\sim}{W}}^{T}\sigma} + {2\alpha\;\sigma^{T}{\sigma ɛ}^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{+ 2}\alpha\;\sigma^{T}\overset{\sim}{W}\sigma^{T}\sigma\; D} + {2\;\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}D^{T}{\overset{\sim}{W}}^{T}\sigma} + {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}r^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}r^{T}K_{v}^{T}W^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}D^{T}W^{T}\sigma} + {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}ɛ^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}ɛ^{T}W^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\sigma^{T}\overset{\sim}{W}{\hat{W}}^{T}\sigma} +} \\ {{+ \frac{1}{\alpha}}{tr}\left\{ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\hat{W}}^{T}\hat{W}} + {2W^{T}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\hat{W}} + {\Gamma^{2}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}{\hat{W}}^{T}\hat{W}}} \right\}} \\ {{Completing}\mspace{14mu}{squares}\mspace{14mu}{for}\mspace{14mu} K_{a}\overset{\sim}{\tau}\mspace{14mu}{and}\mspace{14mu}\overset{\sim}{\tau}} \\ {{\Delta\; L} = {{{- {r^{T}\left\lbrack {{2I} - {\left( {2 + {\alpha\;\sigma^{T}\sigma}} \right)K_{v}^{T}K_{v}}} \right\rbrack}}r} + {2\left( {2 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}K_{v}^{T}D} + {\left( {2 + {\alpha\;\sigma^{T}\sigma}} \right)D^{T}D} +}} \\ {{{+ 2}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}K_{v}^{T}ɛ} + {\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)ɛ^{T}ɛ} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)ɛ^{T}D} +} \\ {{- \left\{ {{K_{a}\overset{\sim}{\tau}} - {\beta^{- 1}\left\lbrack {{\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)\left( {D + ɛ} \right)} - {\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right){\overset{\sim}{W}}^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}W^{T}\sigma}} \right\rbrack}} \right\}^{T}} \cdot \beta \cdot} \\ {\left\{ {{K_{a}\overset{\sim}{\tau}} - {\beta^{- 1}\left\lbrack {{\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)\left( {D + ɛ} \right)} - {\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right){\overset{\sim}{W}}^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}W^{T}\sigma}} \right\rbrack}} \right\} +} \\ {{+ \left\{ {\beta^{- 1}\left\lbrack {{\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)\left( {D + ɛ} \right)} + {\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right){\overset{\sim}{W}}^{T}\sigma} - {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}W^{T}\sigma}} \right\rbrack} \right\}^{T}} \cdot \beta \cdot} \\ {\left\{ {\beta^{- 1}\left\lbrack {{\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)\left( {D + ɛ} \right)} + {\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right){\overset{\sim}{W}}^{T}\sigma} - {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}W^{T}\sigma}} \right\rbrack} \right\} +} \\ {{- {\left\lbrack {\overset{\sim}{\tau} - {\alpha\;\sigma^{T}\sigma\; r} + D + {K_{v}r}} \right\rbrack^{T}\left\lbrack {\overset{\sim}{\tau} - {\alpha\;\sigma^{T}\sigma\; r} + D + {K_{v}r}} \right\rbrack}} + {\left( {\alpha\;\sigma^{T}\sigma} \right)^{2}r^{T}r} + {r^{T}K_{v}^{T}K_{v}r} + {D^{T}D} +} \\ {{{- 2}\alpha\;\sigma^{T}\sigma\; r^{T}D} + {2r^{T}K_{v}^{T}D} - {2\alpha\;\sigma^{T}\sigma\; r^{T}K_{v}r} +} \\ {{{+ 2}\alpha\;\sigma^{T}\sigma\; r^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} - {\left( {1 - {\alpha\;\sigma^{T}\sigma}} \right)\;\sigma^{T}\overset{\sim}{W}{\overset{\sim}{W}}^{T}\sigma} + {2\alpha\;\sigma^{T}{\sigma ɛ}^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{+ 2}\alpha\;\sigma^{T}\overset{\sim}{W}\sigma^{T}\sigma\; D} + {2\;\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}D^{T}{\overset{\sim}{W}}^{T}\sigma} + {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}r^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}r^{T}K_{v}^{T}W^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}D^{T}W^{T}\sigma} + {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}ɛ^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}ɛ^{T}W^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\sigma^{T}\overset{\sim}{W}{\hat{W}}^{T}\sigma} +} \\ {{+ \frac{1}{\alpha}}{tr}\left\{ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\hat{W}}^{T}\hat{W}} + {2W^{T}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\hat{W}} + {\Gamma^{2}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}{\hat{W}}^{T}\hat{W}}} \right\}} \\ {{\left. {{\Delta\; L} = {{- {r^{T}\left\lbrack {{2I} - {\left( {3 + {\alpha\;\sigma^{T}\sigma}} \right)K_{v}^{T}K_{v}}} \right\rbrack}} - \left( {\alpha\;\sigma^{T}\sigma} \right)^{2} + {2\alpha\;\sigma^{T}\sigma\; K_{v}}}} \right\rbrack r} + {2\left( {3 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}K_{v}^{T}D} +} \\ {{{+ \left( {3 + {\alpha\;\sigma^{T}\sigma}} \right)}D^{T}D} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}K_{v}^{T}ɛ} + {\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)ɛ^{T}ɛ} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)ɛ^{T}D} +} \\ {{- \left\{ {{K_{a}\overset{\sim}{\tau}} - {\beta^{- 1}\left\lbrack {{\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)\left( {D + ɛ} \right)} - {\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right){\overset{\sim}{W}}^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}W^{T}\sigma}} \right\rbrack}} \right\}^{T}} \cdot \beta \cdot} \\ {\left\{ {{K_{a}\overset{\sim}{\tau}} - {\beta^{- 1}\left\lbrack {{\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)\left( {D + ɛ} \right)} - {\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right){\overset{\sim}{W}}^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}W^{T}\sigma}} \right\rbrack}} \right\} +} \\ {{- {\left\lbrack {\overset{\sim}{\tau} - {\alpha\;\sigma^{T}\sigma\; r} + D + {K_{v}r}} \right\rbrack^{T}\left\lbrack {\overset{\sim}{\tau} - {\alpha\;\sigma^{T}\sigma\; r} + D + {K_{v}r}} \right\rbrack}} + {{\beta^{- 1}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)}^{2}\left( {D + ɛ} \right)^{2}\left( {D + ɛ} \right)} +} \\ {{{- 2}\alpha\;\sigma^{T}\sigma\; r^{T}D} +} \\ {{{+ 2}{\beta^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)\left( {D + ɛ} \right)^{T}{\overset{\sim}{W}}^{T}\sigma} + {{\beta^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}^{2}\sigma^{T}\overset{\sim}{W}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{+ \beta^{- 1}}\Gamma^{2}{{I - {\alpha\;{\sigma\sigma}^{T}}}}^{2}\sigma^{T}W\; W^{T}\sigma} - {2\;{\beta^{- 1}\left( {1 + {{\alpha\sigma}^{T}\sigma}} \right)}\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}\left( {D + ɛ} \right)^{T}W^{T}\sigma} +} \\ {{{- 2}{\beta^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}\sigma^{T}\overset{\sim}{W}W^{T}\sigma} +} \\ {{{+ 2}\alpha\;\sigma^{T}\sigma\; r^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} - {\left( {1 - {\alpha\;\sigma^{T}\sigma}} \right)\;\sigma^{T}\overset{\sim}{W}{\overset{\sim}{W}}^{T}\sigma} + {2\alpha\;\sigma^{T}{\sigma ɛ}^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{+ 2}\alpha\;\sigma^{T}\overset{\sim}{W}\sigma^{T}\sigma\; D} + {2\;\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}D^{T}{\overset{\sim}{W}}^{T}\sigma} + {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}r^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ \begin{matrix} {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}r^{T}K_{v}^{T}W^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}D^{T}W^{T}\sigma} + {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}ɛ^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}ɛ^{T}W^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\sigma^{T}\overset{\sim}{W}{\hat{W}}^{T}\sigma} +} \\ {{+ \frac{1}{\alpha}}{tr}\left\{ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\hat{W}}^{T}\hat{W}} + {2W^{T}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\hat{W}} + {\Gamma^{2}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}{\hat{W}}^{T}\hat{W}}} \right\}} \\ {{\Delta\; L} = {{{- {r^{T}\left\lbrack {{2I} - {\left( {3 + {\alpha\;\sigma^{T}\sigma}} \right)K_{v}^{T}K_{v}} - \left( {\alpha\;\sigma^{T}\sigma} \right)^{2} + {2\alpha\;\sigma^{T}\sigma\; K_{v}}} \right\rbrack}}r} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}{K_{v}^{T}\left( {D + ɛ} \right)}} +}} \\ {{4r^{T}K_{v}^{T}D} + {2D^{T}D} +} \\ \begin{matrix} {{- \left\{ {{K_{a}\overset{\sim}{\tau}} - {\beta^{- 1}\left\lbrack {{\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)\left( {D + ɛ} \right)} - {\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right){\overset{\sim}{W}}^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}W^{T}\sigma}} \right\rbrack}} \right\}^{T}} \cdot \beta \cdot} \\ {\left\{ {{K_{a}\overset{\sim}{\tau}} - {\beta^{- 1}\left\lbrack {{\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)\left( {D + ɛ} \right)} - {\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right){\overset{\sim}{W}}^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}W^{T}\sigma}} \right\rbrack}} \right\} - {2\alpha\;\sigma^{T}\sigma\; r^{T}D} +} \\ {{- {\left\lbrack {\overset{\sim}{\tau} - {\alpha\;\sigma^{T}\sigma\; r} + D + {K_{v}r}} \right\rbrack^{T}\left\lbrack {\overset{\sim}{\tau} - {\alpha\;\sigma^{T}\sigma\; r} + D + {K_{v}r}} \right\rbrack}} + {{\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)\left\lbrack {1 + {\beta^{- 1}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)}} \right\rbrack}\left( {D + ɛ} \right)^{T}\left( {D + ɛ} \right)} +} \\ {{2\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)r^{T}K_{v}^{T}{\overset{\sim}{W}}^{T}\sigma} - {\left\lbrack {1 - {\alpha\;\sigma^{T}\sigma} - {\beta^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}^{2}} \right\rbrack\sigma^{T}\overset{\sim}{W}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{+ \beta^{- 1}}\Gamma^{2}{{I - {\alpha\;{\sigma\sigma}^{T}}}}^{2}\sigma^{T}W\; W^{T}\sigma} - {2\;{\beta^{- 1}\left( {1 + {{\alpha\sigma}^{T}\sigma}} \right)}\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}\left( {D + ɛ} \right)^{T}W^{T}\sigma} +} \\ {{{- 2}{\beta^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}\sigma^{T}\overset{\sim}{W}W^{T}\sigma} +} \\ {{{+ 2}{\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)\left\lbrack {1 + {\beta^{- 1}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)}}\; \right\rbrack}\left( {D + ɛ} \right)^{T}{\overset{\sim}{W}}^{T}\sigma} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}r^{T}K_{v}^{T}W^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\left( {D + ɛ} \right)^{T}W^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\sigma^{T}\overset{\sim}{W}{\hat{W}}^{T}\sigma} +} \\ {{+ \frac{1}{\alpha}}{tr}\left\{ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\hat{W}}^{T}\hat{W}} + {2W^{T}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\hat{W}} + {\Gamma^{2}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}{\hat{W}}^{T}\hat{W}}} \right\}} \end{matrix} \end{matrix} \end{matrix}$ Define ρ=(1−ασ^(T)σ)I−β⁻¹(ασ^(T)σ+Γ∥I−ασσ^(T)∥)²>0 (condition (36)).

Completing squares for {tilde over (W)}^(T)σ

$\begin{matrix} {{\left. {{\Delta\; L} = {{- {r^{T}\left\lbrack {{2I} - {\left( {3 + {\alpha\;\sigma^{T}\sigma}} \right)K_{v}^{T}K_{v}}} \right\rbrack}} - \left( {\alpha\;\sigma^{T}\sigma} \right)^{2} + {2\alpha\;\sigma^{T}\sigma\; K_{v}}}} \right\rbrack r} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}{K_{v}^{T}\left( {D + ɛ} \right)}} +} \\ {{{+ 4}r^{T}K_{v}^{T}D} + {2D^{T}D} +} \\ {{- \left\{ {{K_{a}\overset{\sim}{\tau}} - {\beta^{- 1}\left\lbrack {{\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)\left( {D + ɛ} \right)} - {\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right){\overset{\sim}{W}}^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}W^{T}\sigma}} \right\rbrack}} \right\}^{T}} \cdot \beta \cdot} \\ {\left\{ {{K_{a}\overset{\sim}{\tau}} - {\beta^{- 1}\left\lbrack {{\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)\left( {D + ɛ} \right)} - {\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right){\overset{\sim}{W}}^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}W^{T}\sigma}} \right\rbrack}} \right\} +} \\ {{- {\left\lbrack {\overset{\sim}{\tau} - {\alpha\;\sigma^{T}\sigma\; r} + D + {K_{v}r}} \right\rbrack^{T}\left\lbrack {\overset{\sim}{\tau} - {\alpha\;\sigma^{T}\sigma\; r} + D + {K_{v}r}} \right\rbrack}} - {2\alpha\;\sigma^{T}\sigma\; r^{T}D} +} \\ {{{+ \left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)}\left( {1 + \frac{1 + {\alpha\;\sigma^{T}\sigma}}{\beta}} \right)\left( {D + ɛ} \right)^{T}\left( {D + ɛ} \right)} +} \\ {{- \left\{ {{{\overset{\sim}{W}}^{T}\sigma} - {{\rho^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}\left\lbrack {{K_{v\;}r} + {\left( {1 + {\beta^{- 1}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)}} \right)\left( {D + ɛ} \right)} - {\beta^{- 1}\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}W^{T}\sigma}} \right\rbrack}} \right\}^{T}}\rho} \\ \left\{ {{{\overset{\sim}{W}}^{T}\sigma} - {{\rho^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}\left\lbrack {{K_{v\;}r} + {\left( {1 + {\beta^{- 1}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)}} \right)\left( {D + ɛ} \right)} - {\beta^{- 1}\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}W^{T}\sigma}} \right\rbrack}} \right\} \\ {+ {{\rho^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}^{2}\left\lbrack {{K_{v\;}r} + {\left( {1 + {\beta^{- 1}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)}} \right)\left( {D + ɛ} \right)} - {\beta^{- 1}\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}W^{T}\sigma}} \right\rbrack}^{T}} \\ {\left\lbrack {{K_{v\;}r} + {\left( {1 + {\beta^{- 1}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)}} \right)\left( {D + ɛ} \right)} - {\beta^{- 1}\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}W^{T}\sigma}} \right\rbrack +} \\ {{{+ \beta^{- 1}}\Gamma^{2}{{I - {\alpha\;{\sigma\sigma}^{T}}}}^{2}\sigma^{T}W\; W^{T}\sigma} - {2\;{\beta^{- 1}\left( {1 + {{\alpha\sigma}^{T}\sigma}} \right)}\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}\left( {D + ɛ} \right)^{T}W^{T}\sigma} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}r^{T}K_{v}^{T}W^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\left( {D + ɛ} \right)^{T}W^{T}\sigma} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\sigma^{T}\overset{\sim}{W}{\hat{W}}^{T}\sigma} +} \\ {{+ \frac{1}{\alpha}}{tr}\left\{ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\hat{W}}^{T}\hat{W}} + {2W^{T}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\hat{W}} + {\Gamma^{2}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}{\hat{W}}^{T}\hat{W}}} \right\}} \end{matrix}$

Putting the term −2Γ∥I−α·Γ^(T)σ∥σ^(T){tilde over (W)}Ŵ^(T)σ back on the trace term and bounding the trace term.

$\begin{matrix} {\frac{1}{\alpha}{tr}\left\{ {{{- 2}{\alpha\Gamma}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\overset{\sim}{W}}^{T}{\sigma\sigma}^{T}\hat{W}} + {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\overset{\sim}{W}}^{T}\hat{W}} + {{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}{\hat{W}}^{T}\Gamma^{T}\Gamma\hat{W}}} \right\}} \\ {= {{{- \frac{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\alpha}}{tr}\left\{ {{2{\alpha\Gamma}{\overset{\sim}{W}}^{T}{\sigma\sigma}^{T}\hat{W}} - {2\Gamma{\overset{\sim}{W}}^{T}\hat{W}} + {{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\hat{W}}^{T}\Gamma^{T}\Gamma\hat{W}}} \right\}} =}} \\ {= {{- \frac{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\alpha}}{tr}\left\{ {{2{\alpha\Gamma}{\overset{\sim}{W}}^{T}{{\sigma\sigma}^{T}\left( {W - \hat{W}} \right)}} - {2\Gamma{{\overset{\sim}{W}}^{T}\left( {W - \hat{W}} \right)}} +} \right.}} \\ {{{- {{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}}\left( {W - \hat{W}} \right)\Gamma^{T}{\Gamma\left( {W - \hat{W}} \right)}} =} \\ {= {{- \frac{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\alpha}}{tr}\left\{ {{2{\alpha\Gamma}{\overset{\sim}{W}}^{T}{\sigma\sigma}^{T}W} - {2{\alpha\Gamma}{\overset{\sim}{W}}^{T}{\sigma\sigma}^{T}\overset{\sim}{W}} - {2\Gamma{\overset{\sim}{W}}^{T}W} + {2\;\Gamma{\overset{\sim}{W}}^{T}\overset{\sim}{W}} +} \right.}} \\ {\left. {{{- \Gamma^{2}}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\; W^{T}W} + {2\;\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}W^{T}\overset{\sim}{W}} - {\Gamma^{2}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\overset{\sim}{W}}^{T}\overset{\sim}{W}}} \right\} =} \\ {{< {{- \frac{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\alpha}}\left\{ {{{\Gamma\left( {2 - \Gamma} \right)}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}{\overset{\sim}{W}}^{2}} - {\Gamma^{2}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}\overset{\sim}{}}W_{M}^{2}}} \right\}}} =} \\ {< {{- \frac{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}}{\alpha}}\left\{ {{{\Gamma\left( {2 - \Gamma} \right)}{\overset{\sim}{W}}^{2}} - {\Gamma^{2}W_{M}^{2}}} \right\}}} \\ {Bounding} \\ {{\left. {{\Delta\; L} < {{- {r^{T}\left\lbrack {{2I} - {\left( {3 + {\alpha\;\sigma^{T}\sigma}} \right)K_{v}^{T}K_{v}}} \right\rbrack}} - \left( {\alpha\;\sigma^{T}\sigma} \right)^{2} + {2\alpha\;\sigma^{T}\sigma\; K_{v}}}} \right\rbrack r} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}{K_{v}^{T}\left( {D + ɛ} \right)}} +} \\ {{{+ 4}r^{T}K_{v}^{T}D} + {2D^{T}D} +} \\ {{{+ \left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)}\left\lfloor {1 + {\beta^{- 1}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)}} \right\rfloor\left( {D + ɛ} \right)^{T}\left( {D + ɛ} \right)} - {2{\alpha\sigma}^{T}\sigma\; r^{T}D} +} \\ {+ {{\rho^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}^{2}\left\lbrack {{K_{v\;}r} + {\left( {1 + {\beta^{- 1}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)}} \right)\left( {D + ɛ} \right)} - {\beta^{- 1}\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}W^{T}\sigma}} \right\rbrack}^{T}} \\ {\left\lbrack {{K_{v\;}r} + {\left( {1 + {\beta^{- 1}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)}} \right)\left( {D + ɛ} \right)} - {\beta^{- 1}\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}W^{T}\sigma}} \right\rbrack +} \\ {{\beta^{- 1}\Gamma^{2}{{I - {\alpha\;{\sigma\sigma}^{T}}}}^{2}\sigma^{T}W\; W^{T}\sigma} - {2\;{\beta^{- 1}\left( {1 + {{\alpha\sigma}^{T}\sigma}} \right)}\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}\left( {D + ɛ} \right)^{T}W^{T}\sigma} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}r^{T}K_{v}^{T}W^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\left( {D + ɛ} \right)^{T}W^{T}\sigma} +} \\ {{{- \frac{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}}{\alpha}}{\Gamma\left( {2 - \Gamma} \right)}{\overset{\sim}{W}}^{2}} + {\frac{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}}{\alpha}\Gamma^{2}W_{M}^{2}}} \\ \begin{matrix} {{\Delta\; L} < {{{- {r^{T}\left\lbrack {{2I} - {\left( {3 + {\alpha\;\sigma^{T}\sigma}} \right)K_{v}^{T}K_{v}} - \left( {\alpha\;\sigma^{T}\sigma} \right)^{2} + {2\alpha\;\sigma^{T}\sigma\; K_{v}}} \right\rbrack}}r} + {2\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)r^{T}{K_{v}^{T}\left( {D + ɛ} \right)}} +}} \\ {{{+ 4}r^{T}K_{v}^{T}D} + {2D^{T}D} +} \\ {{{+ \left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)}\left\lfloor {1 + {\beta^{- 1}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)}} \right\rfloor\left( {D + ɛ} \right)^{T}\left( {D + ɛ} \right)} - {2{\alpha\sigma}^{T}\sigma\; r^{T}D} +} \\ {+ {{\rho^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}^{2}\left\lbrack {{r^{T}K_{v}^{T}K_{v\;}r} + {\left( {1 + {\beta^{- 1}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)}} \right)^{2}\left( {D + ɛ} \right)^{T}\left( {D + ɛ} \right)} +} \right.}} \end{matrix} \\ \begin{matrix} {{\beta^{- 2}\Gamma^{2}{{I - {\alpha\;{\sigma\sigma}^{T}}}}^{2}\sigma^{T}W\; W^{T}\sigma} + {2\left( {1 - {\beta^{- 1}\left( {1 + {{\alpha\sigma}^{T}\sigma}} \right)}} \right)\left( {D + ɛ} \right)^{T}K_{v\;}r}\; - {2\;\beta^{- 1}\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}\sigma^{T}W\; K_{v}r} +} \\ {\left. {{- 2}\left( {1 + {\beta^{- 1}\left( {1 + {{\alpha\sigma}^{T}\sigma}} \right)}} \right)\beta^{- 1}\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}\left( {D + ɛ} \right)^{T}W^{T}\sigma} \right\rbrack +} \\ {{{+ \beta^{- 1}}\Gamma^{2}{{I - {\alpha\;{\sigma\sigma}^{T}}}}^{2}\sigma^{T}W\; W^{T}\sigma} - {2{\beta^{- 1}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)}\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}\left( {D + ɛ} \right)^{T}W^{T}\sigma} +} \\ {{{- 2}\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}r^{T}K_{v}^{T}W^{T}\sigma} - {2\Gamma{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\left( {D + ɛ} \right)^{T}W^{T}\sigma} +} \\ {{{- \frac{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}}{\alpha}}{\Gamma\left( {2 - \Gamma} \right)}{\overset{\sim}{W}}^{2}} + {\frac{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}}{\alpha}\Gamma^{2}W_{M}^{2}}} \\ {Define} \\ {\eta = {{{\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)I} + {\rho^{- 1}\left( {{{\alpha\sigma}^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}^{2}} > {0\left( {{condition}\mspace{11mu}(38)} \right)\;{and}}}} \\ {\gamma = {{\eta + {\beta^{- 1}{\rho^{- 1}\left( {1 + {\alpha\;\sigma^{T}\sigma}} \right)}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)^{2}}} > 0}} \\ {S{ubstituting}} \\ {{\Delta\; J} < {{{- {r^{T}\left\lbrack {{2I} - \left( {\alpha\;\sigma^{T}\sigma} \right)^{2} + {2\;\alpha\;\sigma^{T}\sigma\; K_{v}} - {\left( {\eta + 2} \right)K_{v}^{T}K_{v}}} \right\rbrack}}r} + {2{\gamma \cdot r^{T}}{K_{v}^{T}\left( {D + ɛ} \right)}} +}} \\ {{{+ \gamma}\left\lfloor {1 + {\beta^{- 1}\left( {1 + {{\alpha\sigma}^{T}\sigma}} \right)}} \right\rfloor\left( {D + ɛ} \right)^{T}\left( {D + ɛ} \right)} + {4r^{T}K_{v}^{T}D} + {2D^{T}D} - {2\;\alpha\;\sigma^{T}\sigma\; r^{T}D} +} \\ {{{- 2}\Gamma{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\left\lbrack {{\beta^{- 1}{\rho^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}^{2}} + 1} \right\rbrack}\sigma^{T}W\; K_{v\;}r} -} \\ {{2\Gamma{{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\left\lbrack {1 + {\beta^{- 1}\left( {1 + {{\alpha\sigma}^{T}\sigma}} \right)}} \right\rbrack}\left\lbrack {1 + {\beta^{- 1}{\rho^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}^{2}}} \right\rbrack}\left( {D + ɛ} \right)^{T}\; W^{T}\sigma} +} \\ {{{- \frac{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}}{\alpha}}{\Gamma\left( {2 - \Gamma} \right)}{\overset{\sim}{W}}^{2}} + {\frac{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}}{\alpha}\Gamma^{2}W_{M}^{2}} +} \\ {{{+ \beta^{- 2}}{\rho^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}^{2}\Gamma^{2}{{I - {\alpha\;{\sigma\sigma}^{T}}}}^{2}\sigma^{T}W\; W^{T}\sigma} + {\beta^{- 1}\Gamma^{2}{{I - {\alpha\;{\sigma\sigma}^{T}}}}^{2}\sigma^{T}W\; W^{T}\sigma}} \\ {{\Delta\; J} < {{{- \left\lbrack {2 - \left( {\alpha\;\sigma^{T}\sigma} \right)^{2} + {2\;\alpha\;\sigma^{T}\sigma\; K_{V\;\min}} - {\left( {\eta + 2} \right)K_{v\;\max}^{2}}} \right\rbrack}{r}^{2}} + {2{\gamma \cdot {r}}{K_{v\;\max}\left( {D_{M} + ɛ_{M}} \right)}} +}} \\ \begin{matrix} {{{+ \gamma}\left\lfloor {1 + {\beta^{- 1}\left( {1 + {{\alpha\sigma}^{T}\sigma}} \right)}} \right\rfloor\left( {D_{M} + ɛ_{M}} \right)^{2}} + {4{r}K_{v\;\max}D_{M}} + {2D_{M}^{2}} + {2\;\alpha\;\sigma_{M}^{2}{r}D_{M}} +} \\ {{{+ 2}\Gamma{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\left\lbrack {{\beta^{- 1}{\rho^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}^{2}} + 1} \right\rbrack}\sigma_{M}W_{M}\; K_{{v\mspace{11mu}\max}\;}{r}} +} \end{matrix} \\ {{{+ 2}\Gamma{{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\left\lbrack {1 + {\beta^{- 1}\left( {1 + {{\alpha\sigma}^{T}\sigma}} \right)}} \right\rbrack}\left\lbrack {1 + {\rho^{- 1}{\beta^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}^{2}}} \right\rbrack}\left( {D_{M} + ɛ_{M}} \right)\; W_{M}\sigma_{M}} +} \\ {{{- \frac{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}}{\alpha}}{\Gamma\left( {2 - \Gamma} \right)}{\overset{\sim}{W}}^{2}} + {\frac{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}}{\alpha}\Gamma^{2}W_{M}^{2}} +} \\ {{{+ \rho^{- 1}}{\beta^{- 2}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}^{2}\Gamma^{2}{{I - {\alpha\;{\sigma\sigma}^{T}}}}^{2}\sigma_{M}^{2}W_{M}^{2}} + {\beta^{- 1}\Gamma^{2}{{I - {\alpha\;{\sigma\sigma}^{T}}}}^{2}\sigma_{M}^{2}W_{M}^{2}}} \\ {Define} \\ {\rho_{1} = {{2 - \left( {\alpha\;\sigma^{T}\sigma} \right)^{2} + {2\;\alpha\;\sigma^{T}\sigma\; K_{V\;\min}} - {\left( {\eta + 2} \right)K_{v\;\max}^{2}}} > {0\;\left( {{see}\mspace{11mu}{{conditions}(33)}\;{and}\;(35)} \right)}}} \\ {\rho_{2} = {{\Gamma{{{I - {\alpha\;{\sigma\sigma}^{T}}}}\left\lbrack {{\beta^{- 1}{\rho^{- 1}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)}^{2}} + 1} \right\rbrack}\sigma_{M}W_{M}\; K_{{v\;\max}\;}} + {\gamma\; K_{v\;\max}ɛ_{M}} +}} \\ {{+ \left\lbrack {{\left( {\gamma + 2} \right)K_{{v\mspace{11mu}\max}\;}} + {\alpha\sigma}_{M}^{2}} \right\rbrack}D_{M}} \\ {\rho_{3} = {{\gamma\left\lfloor {1 + {{\beta^{- 1}}\left( {1 + {{\alpha\sigma}^{T}\sigma}} \right)}} \right\rfloor\left( {D_{M} + ɛ_{M}} \right)^{2}} + {2D_{M}^{2}} +}} \\ {{{+ 2}\Gamma{{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\left\lbrack {1 + {{\beta^{- 1}}\left( {1 + {{\alpha\sigma}^{T}\sigma}} \right)}} \right\rbrack} \cdot \left\lbrack {1 + {{{\rho^{- 1}\beta^{- 1}}}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)^{2}}} \right\rbrack \cdot \left( {D_{M} + ɛ_{M}} \right)}\; W_{M}\sigma_{M}} +} \\ {{{+ \frac{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}}{\alpha}}\Gamma^{2}W_{M}^{2}} + {{{\beta^{- 1}} \cdot \Gamma^{2}}{{{I - {\alpha\;{\sigma\sigma}^{T}}}}^{2}\left\lbrack {1 + {{{\rho^{- 1}\beta^{- 1}}}\left( {{\alpha\;\sigma^{T}\sigma} + {\Gamma{{I - {\alpha\;{\sigma\sigma}^{T}}}}}} \right)^{2}}} \right\rbrack}\sigma_{M}^{2}W_{M}^{2}}} \\ {{\Delta\; J} < {{{- \rho_{1}}{r}^{2}} + {2\rho_{2}{r}} + \rho_{3} - {\frac{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}}{\alpha}{\Gamma\left( {2 - \Gamma} \right)}{\overset{\sim}{W}}^{2}}}} \\ {{completing}\mspace{14mu}{squares}\mspace{14mu}{for}\mspace{14mu}{r}} \\ {{\Delta\; J} < {{- {\rho_{1}\left\lbrack {{r} - \frac{\rho_{2}}{\rho_{1}}} \right\rbrack}^{2}} + \frac{\rho_{2}^{2}}{\rho_{1}} + \rho_{3} - {\frac{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}}{\alpha}{\Gamma\left( {2 - \Gamma} \right)}{\overset{\sim}{W}}^{2}}}} \\ {{which}\mspace{14mu}{is}\mspace{14mu}{negative}\mspace{14mu}{as}\mspace{14mu}{long}\mspace{14mu}{as}} \\ \left. {{\frac{{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}^{2}}{\alpha}{\Gamma\left( {2 - \Gamma} \right)}{\overset{\sim}{W}}^{2}} > {\frac{\rho_{2}^{2}}{\rho_{1}} + \rho_{3}}}\Rightarrow{{\overset{\sim}{W}} > {\frac{1}{{I - {\alpha \cdot \;\sigma \cdot \sigma^{T}}}}\sqrt{\frac{\alpha\left( {\rho_{2}^{2} + {\rho_{1}\rho_{3}}} \right)}{\rho_{1}{\Gamma\left( {2 - \Gamma} \right)}}}}} \right. \\ {or} \\ \left. {{\rho_{1}\left\lbrack {{r} - \frac{\rho_{2}}{\rho_{1}}} \right\rbrack}^{2} > {\frac{\rho_{2}^{2}}{\rho_{1}} + \rho_{3}}}\Rightarrow{{r} > \frac{\rho_{2} + \sqrt{\rho_{2}^{2} + {\rho_{1}\rho_{3}}}}{\rho_{1}}} \right. \end{matrix} \end{matrix}$

From the above results, ΔL is negative outside a compact set. According to a standard Lyapunov theorem extension, it can be concluded that the tracking error r(k), the actuator error {tilde over (τ)}(k) and the NN weights estimates {tilde over (W)}(k) are Globally Uniformly Ultimately Bounded (GUUB).

REFERENCES

The following materials are incorporated herein by reference.

-   1. Pending U.S. patent application Ser. No. 09/553,601 entitled     “Backlash compensation using neural network” by Selmic et al., filed     Apr. 20, 2000. -   2. U.S. Pat. No. 6,185,469. -   3. U.S. Pat. No. 6,064,997. -   4. U.S. Pat. No. 5,943,660. -   5. A. R. Barron, “Universal approximation bounds for superposition     of a sigmoidal function,” IEEE Trans. Inform. Theory, vol. 39, no.     3, pp. 930–945, 1993. -   6. L. A. Bernotas, P. E. Crago, and H. J. Chizeck, “Adaptive control     of electrically stimulated muscle,” IEEE Trans. on Biomedical     Engineering, no. 34, pp. 140–147, 1987. -   7. C. I. Byrnes and W. Lin, “Losslessness, feedback equivalence, and     the global stabilization of discrete-time nonlinear systems,” IEEE     Transactions of Automatic Control, vol. 39, no. 1, pp. 83–98,     January 1994. -   8. J. Campos, F. L. Lewis, and R. Selmic, “Backlash compensation in     discrete time nonlinear systems using dynamic inversion by neural     networks: A preliminary approach,” submitted to the special issue on     Developments in Intelligent Control for Industrial Applications of     the Int. Journal of Adaptive Control and Signal Processing,     November, 1999. -   9. J. Campos and F. L. Lewis, “Deadzone compensation in discrete     time using adaptive fuzzy logic,” Proc. IEEE Conference on Decision     and Control, pp. 2920–2926, Tampa, Fla., 1998. -   10. F. C. Chen and H. K. Khalil, “Adaptive control of nonlinear     discrete-time systems using neural networks,” IEEE Trans. on     Automatic Control, vol. 450, no. 5, pp. 791–801, May 1995. -   11. C. A. Desoer and S. M. Shahruz, “Stability of dithered nonlinear     systems with backlash or hysteresis,” Int. J. Control, vol. 43, no.     4, pp. 1045–1060, 1986. -   12. M. Grundelius and D. Angelli, “Adaptive control of systems with     backlash acting on the input,” Proceedings of the 35^(th) Conference     on Decision and Control, pp. 4689–4694, Kobe, Japan, 1996. -   13. V. Gullapalli, J. A. Franklin, and H. Benbrahuim, “Acquiring     robot skills via reinforcement learning,” IEEE Cont. Syst., pp.     13–24, February 1994. -   14. W. M. Haddad, J. L. Fausz, and V. Chellaboina, “Optimal     discrete-time control for nonlinear cascade systems,” Proceedings of     the American Control Conference, pp. 2175–2176, Albuquerque, N.Mex.,     1997. -   15. C. W. Han and Y. X. Zhong, “Robust adaptive control of     time-varying systems with unknown backlash nonlinearity,”     Proceedings of the American Control Conference, pp. 763–767,     Albuquerque, N.Mex., 1997. -   16. K. Hornik, M. Stinchombe, and H. White. “Multilayer feedforward     networks are universal approximators,” Neural Networks vol. 2, pp.     359–366, 1989. -   17. B. Igelnik and Y-H. Pao, “Stochastic choice of basis functions     in adaptive function approximation and the functional-link net,”     IEEE Trans. on Neural Networks, vol. 6, no. 6, pp. 1320–1329,     November 1995. -   18. P. A. Ioannou and A. Datta, “Robust adaptive control: a unified     approach, ” Proc. IEEE, vol. 790, no. 12, pp. 1736–1768, 1991. -   19. S. Jagannathan, and F. L. Lewis, “Discrete-Time Control of a     Class of Nonlinear Dynamical Systems,” Int. Journal of Intelligent     Control and Systems, vol. 1, no. 3, pp. 297–326, 1996. -   20. S. Jagannathan, “Robust backstepping control of robotic systems     using neural networks,” Proc. Of the IEEE Conf. on Decision &     Control, pp. 943–948, December 1998. -   21. J.-H. Kim, S.-W. Lee, and K.-C Kim, “Fuzzy precompensation of     PID controllers,” Proc. IEEE Conf. Control Applications, pp.     183–188, September. 1993. -   22. J.-H. Kim, J.-H. Park, S.-W. Lee, and E. K. P Chong, “Fuzzy     precompensation of PD controllers for systems with deadzones,” J.     Int. And Fuzzy Systems, vol. 1, pp. 125–133, 1993. -   23. J.-H. Kim, J.-H. Park, S.-W. Lee, and E. K. P Chong, “A     two-layered fuzzy logic controller for systems with deadzones,” IEEE     Trans. Industrial Electron., vol. 41, no. 2, pp. 155–162, April.     1994. -   24. B. Kosko, Neural Networks and Fuzzy Systems, Prentice Hall,     N.J., 1992. -   25. M. Krstic, I. Kanellahopoulos, and P. Kokotovic, Nonlinear and     Adaptive Control Design, John Wiley & Sons, New York, N.Y., 1995. -   26. J. Leitner, A. Calise and J. V. R. Prasad, “Analysis of adaptive     neural networks for helicopter flight control,” Journal of Guidance,     Control, and Dynamics, vol. 20, no. 5, pp. 972–979,     September–October 1997. -   27. F. L. Lewis, C. T. Abdallah, and D. M. Dawson, Control of Robot     Manipulators, MacMillan, N.Y., 1993. -   28. F. L. Lewis, S. Jagannathan, and A. Yesildirek, Neural Network     Control of Robot Manipulators and Nonlinear Systems, Taylor &     Francis, Philadelphia, Pa. 1999. -   29. F. L. Lewis, K. Liu, R. Selmic, and L.-X. Wang, “Adaptive fuzzy     logic compensation of actuator deadzones,” J. Robotic Systems, pp.     501–511, 1997. -   30. F. L. Lewis, A. Yesildirek, and K. Liu, “Neural net robot     controller with guaranteed tracking performance,” IEEE Trans. Neural     Networks, vol. 6, no. 3, pp. 703–715, 1995. -   31. F. L. Lewis, A. Yesildirek, and K. Liu, “Multilayer Neural-Net     Robot Controller with Guaranteed Tracking Performance,” IEEE Trans.     Neural Networks, vol. 7, no. 2, pp. 388–399, 1996. -   32. M. B. McFarland and A. J. Calise, “Multilayer neural network and     adaptive nonlinear control of agile anti-air missiles,” Preprint,     1999. -   33. K. S. Narendra and A. M Annaswamy, “A new adaptive law for     robust adaptation without persistent excitation,” IEEE Trans.     Automatic Control, vol. 32, no. 2, pp. 4–27, 1990. -   34. K. S. Narendra and K. Parthasarathy, “Identification and control     of dynamical systems using neural networks,” IEEE Trans. Neural     Networks, vol. 4, no. 6, pp. 982–988, 1993. -   35. M. M. Polycarpou and P. A. Ioannou., “Identification and control     using neural networks models: Design and stability analysis,”     Technical Report 91-09-01, Department of Electrical Engineering     Systems, University of Southern California, 1991. -   36. N. Sadegh, “A perceptron network for functional identification     and control of nonlinear systems,” IEEE Trans. Neural Networks, vol.     4, pp. 1823–1836, 1992. -   37. R. M. Sanner and J-J. E. Slotine, “Gaussian networks for direct     adaptive control,” IEEE Trans. Neural Networks, vol. 3, pp. 837–863,     1992. -   38. R. Selmic and F. L. Lewis, “Backlash Compensation in Nonlinear     Systems using Dynamic Inversion by Neural Networks,” To appear at     the Conference in Control and Automation, Kona, Hi., August 1999. -   39. R. Selmic and F. L. Lewis, “Deadzone compensation in nonlinear     systems using neural networks,” Proc. IEEE Conference Decision and     Control, Tampa, Fla., 1998. -   40. J. J. E, Slotine, and W. Li, Applied Nonlinear Control, New     Jersey: Prentice-Hall, 1991. -   41. J. J. E. Slotine and W. Li., “Adaptive manipulator control: a     case study,” IEEE Trans. Automat. Control, vol. 33, no. 11, pp.     995–1003, November. 1988. -   42. Y. D. Song, T. L. Mitchell, and H. Y. Lai, “Control of a class     of nonlinear uncertain systems via compensated inverse dynamics     approach,” IEEE Trans. Automatic Control, vol. 39, no. 9, pp.     1866–1871, September 1994. -   43. G. Tao, “Adaptive backlash compensation for robot control,”     Proceedings IFAC World Congress, pp. 307–312, San Francisco, 1996. -   44. G. Tao and P. V. Kokotovic, “Adaptive control of plants with     unknown dead-zones,” Proceedings, American Control Conf., pp.     2710–2714, Chicago, 1992. -   45. G. Tao and P. V. Kokotovic, Adaptive Control of Systems with     Actuator and Sensor Nonlinearities, John Wiley & Sons, Inc., New     York, 1996. -   46. G. Tao and P. V. Kokotovic, “Continuous-time adaptive control of     system with unknown backlash,” IEEE Trans. Automatic Control, vol.     40, no. 6, pp. 1083–1087, June 1995. -   47. G. Tao and P. V. Kokotovic, “Discrete-time adaptive control of     systems with unknown nonsmooth input nonlinearities,” Proceedings of     the 33^(rd) Conference on Decision and Control, pp. 1171–1176, Lake     Buena Vista, Fla., 1994. -   48. G. Tao and P. V. Kokotovic, “Discrete-time adaptive control of     nonlinear systems with unknown deadzones,” Int. J. Control, vol. 61,     no. 1, pp. 1–17, 1995. -   49. M. Vandergrift, F. L. Lewis, S. Jagannathan, and K. Liu,     “Adaptive fuzzy logic control of discrete-time dynamical systems,”     Proc. IEEE Int. Symp. Intelligent Control, pp. 395–401, August.     1995. -   50. P. J. Werbos, “Backpropagation through time: what it does and     how to do it,” Proc. IEEE, vol. 78, no. 10, pp. 1550–1560, 1990. -   51. P. J. Werbos, “Neurocontrol and supervised learning: an overview     and evaluation,” in Handbook of Intelligent Control, D. A. White     and D. A. Sofge, Eds. NY: Van Nostrand Reinhold, 1992, pp. 65–89. -   52. P.-C. Yeh and P. Kokotovic, “Adaptive control of a class of     nonlinear discrete-time systems,” International Journal of Control,     vol. 62, no. 2, pp. 303–324, 1995. -   53. Y. Zhang and Y. C. Soh, “Robust adaptive control of uncertain     discrete-time systems,” Automatica, pp. 321–329, September 1998. 

1. A discrete-time adaptive neural network compensator for compensating backlash of a mechanical system, comprising: a feedforward path; a proportional derivative tracking loop in the feedforward path; a filter in the feedforward path; a neural network in the feedforward path and coupled to the filter, the neural network configured to compensate the backlash by estimating an inverse of the backlash and applying the inverse to an input of the mechanical system; and wherein a tracking error r(k), a backlash estimation error {tilde over (τ)}(k), and a weight estimation error {tilde over (W)}(k) of the neural network are each weighted in the same Lyapunov function.
 2. The compensator of claim 1, wherein the tracking error, the backlash estimation error, and the weight estimation error are uniformly ultimately bounded.
 3. The compensator of claim 1, wherein unknown backlash parameters are learned in real time.
 4. The compensator of claim 1, wherein the mechanical system comprises an actuator or robot.
 5. A discrete time adaptive neural network compensator for compensating backlash of a mechanical system, comprising: a filter in a feedforward path; a neural network in the feedforward path, the neural network configured to compensate the backlash by estimating an inverse of the backlash and applying the inverse to an input of the mechanical system; and means for tuning the neural network in discrete time without a certainty equivalence assumption.
 6. The compensator of claim 5, wherein unknown backlash parameters are learned in real time.
 7. The compensator of claim 5, wherein the mechanical system comprises an actuator or robot.
 8. A method for compensating backlash in a mechanical system, comprising: estimating an inverse of the backlash using a discrete-time neural network in a feedforward path; weighting a tracking error r(k), a backlash estimation error {tilde over (τ)}(k), and a weight estimation error {tilde over (W)}(k) of the neural network in the same Lyapunov function; and applying the inverse to an input of the mechanical system to compensate the backlash.
 9. The method of claim 8, wherein the tracking error, the backlash estimation error, and the weight estimation error are uniformly ultimately bounded.
 10. The method of claim 8, wherein unknown backlash parameters are learned in real time.
 11. The method of claim 8, wherein the mechanical system comprises an actuator or robot.
 12. A discrete-time method of adaptively compensating backlash in a mechanical system, comprising: estimating an inverse of the backlash using a neural network in a feedforward path; adjusting weights of the neural network using an algorithm to achieve closed loop stability without a certainty equivalence assumption; and applying the inverse to an input of the mechanical system to compensate the backlash.
 13. The method of claim 12, wherein a tracking error, backlash estimation error, and weight estimation error are uniformly ultimately bounded.
 14. The method of claim 12, wherein unknown backlash parameters are learned in real time.
 15. The method of claim 12, wherein the mechanical system comprises an actuator or robot. 